00000001:02000400:0.0F:1787430605.098579:0:3304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787430616.019915:0:3503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787430617.183838:0:3566:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1071 MB/s 00000001:01000000:0.0:1787430617.433863:0:3566:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1303 MB/s 00000001:01000000:0.0:1787430617.683684:0:3566:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6295 MB/s 00000020:02000000:0.0:1787430618.062569:0:3596:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_63_g4e64706 00000400:02000000:0.0:1787430618.572029:0:3611:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.125@tcp [8/256/0/180] 00008000:02000000:2.0:1787430621.171129:0:3760:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787430657.511250:0:5724:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787430666.113096:0:6473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787430666.113102:0:6473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787430666.113104:0:6473:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787430666.113664:0:6473:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a615f07c 00000080:02000400:2.0:1787430666.113676:0:6473:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787430666.121316:0:6473:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787430666.121656:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787430666.121723:0:6473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d0d239ee) 00000020:00000080:2.0:1787430666.121756:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787430666.164087:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787430666.164236:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1787430666.189132:0:6473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787430666.193702:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787430666.193716:0:6473:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787430666.193735:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93a91 00000020:01000004:3.0:1787430666.193746:0:6473:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787430666.193752:0:6473:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787430666.193759:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a615f07c from MGS 00000020:01000004:3.0:1787430666.193765:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787430666.193793:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005fbfbace) 00000020:00000080:3.0:1787430666.193809:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787430666.193948:0:6473:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a615f07c from MGS, refs=2 00080000:01000000:3.0:1787430666.193954:0:6473:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787430666.193960:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93a9f 00000100:00100000:3.0:1787430666.194085:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787430666.194237:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787430666.194245:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0F:1787430666.196577:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787430666.196596:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787430666.198052:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430666.198241:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787430666.198246:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787430666.199881:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787430666.199895:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787430666.200570:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787430666.200578:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787430666.200930:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430666.201003:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430666.201005:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430666.206622:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430666.206631:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430666.206635:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430666.207850:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787430666.213925:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787430666.457164:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4431 MB/s 00000001:01000000:0.0:1787430666.706788:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6479 MB/s 00000001:01000000:3.0:1787430666.956883:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1115 MB/s 00000001:01000000:3.0:1787430667.208557:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1143 MB/s 00080000:10000000:3.0:1787430667.219209:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1787430667.228364:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787430667.230868:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787430667.230923:0:6473:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787430667.230957:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787430667.231145:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787430667.231168:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787430667.231481:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430667.231707:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787430667.231714:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787430667.238724:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787430667.238741:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787430667.239335:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787430667.239343:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787430667.240303:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787430667.240325:0:6473:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.125@tcp' 00000020:01000004:3.0:1787430667.240328:0:6473:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787430667.240391:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.125@tcp (typ=mgc) 00000020:00000080:3.0:1787430667.240404:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.125@tcp (000000007c272721) 00000020:00000080:3.0:1787430667.240418:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787430667.240506:0:6473:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ecd92bc4@MGC192.168.202.125@tcp: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1787430667.240737:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.125@tcp-0 is initialized 00000040:01000000:3.0:1787430667.240744:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787430667.240924:0:6494:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787430667.240946:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.125@tcp (uuid d3f3caeb-2c11-4e8c-831c-fee5cea3edde) 00000020:00000080:3.0:1787430667.240958:0:6473:0:(genops.c:1385:class_connect()) connect: client d3f3caeb-2c11-4e8c-831c-fee5cea3edde, cookie 0x4dbb683ba6a93aad 00000100:00080000:3.0:1787430667.240966:0:6473:0:(import.c:510:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430667.240971:0:6473:0:(import.c:624:import_select_connection()) MGC192.168.202.125@tcp: import 00000000ecd92bc4 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430667.241005:0:6473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000532482f5 x1874256847700096/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430667.241028:0:6473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS 00000020:01000004:3.0:1787430667.241042:0:6473:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787430667.241046:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787430667.241055:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f3b570d8) 00000020:00000080:3.0:1787430667.241063:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787430667.241096:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000532482f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847700096:0@lo:250: 00000100:00100000:2.0:1787430667.241965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787430667.245821:0:6493:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1787430667.250586:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430667.250898:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787430667.250906:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787430667.250970:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700096 00000100:00100000:3.0:1787430667.250981:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700096 00000100:00100000:3.0:1787430667.251022:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430667.251029:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0ac9856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3626:x1874256847700096:12345-0@lo:250: 00010000:00080000:3.0:1787430667.251054:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d3f3caeb-2c11-4e8c-831c-fee5cea3edde@0@lo t0 exp 0000000000000000 cur 128 last 0 00000020:00000080:3.0:1787430667.251086:0:6489:0:(genops.c:1385:class_connect()) connect: client d3f3caeb-2c11-4e8c-831c-fee5cea3edde, cookie 0x4dbb683ba6a93abb 00000100:00080000:3.0:1787430667.251235:0:6489:0:(import.c:65:import_set_state_nolock()) 000000000c3329fd : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430667.251407:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0ac9856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:3626:x1874256847700096:12345-0@lo:250: Request processed in 377us (9445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430667.251421:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430667.252429:0:3626:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787430667.252443:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.125@tcp: connect to target with instance 0 00000100:00080000:2.0:1787430667.252451:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787430667.252456:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787430667.252459:0:3626:0:(import.c:65:import_set_state_nolock()) 00000000ecd92bc4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787430667.252462:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787430667.252473:0:3626:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787430667.252479:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000532482f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847700096:0@lo:250: 00000100:00100000:3.0:1787430667.254934:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787430667.254947:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787430667.255814:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787430667.255825:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787430667.256474:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430667.256693:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787430667.256699:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787430667.257192:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787430667.257201:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:1.0:1787430667.266739:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430667.281345:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430667.281568:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787430667.281575:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787430667.284871:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787430667.284889:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787430667.285538:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430667.285925:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787430667.285931:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787430667.286444:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787430667.286450:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787430667.288944:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430667.289115:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787430667.289120:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787430667.290241:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787430667.290249:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787430667.292976:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430667.293117:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787430667.293123:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787430667.293714:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787430667.293722:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787430667.308000:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430667.308333:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787430667.308341:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787430667.311877:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787430667.311892:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787430667.313048:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787430667.313129:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787430667.314536:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787430667.314564:0:6473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787430667.314570:0:6473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787430667.314793:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787430667.314900:0:6473:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787430667.314905:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787430667.314907:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787430667.314908:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430667.314909:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430667.314910:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430667.314911:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430667.314912:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787430667.314914:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787430667.314915:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787430667.314916:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787430667.314918:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430667.314919:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430667.314921:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787430667.314924:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787430667.314925:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787430667.314926:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430667.314927:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430667.314928:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430667.314929:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430667.314930:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787430667.314936:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787430667.314937:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787430667.314937:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787430667.314938:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430667.314939:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430667.314963:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787430667.314981:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000313c3a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700224:0@lo:253: 00000100:00100000:3.0:1787430667.315123:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.315217:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000007db1e8f2 going to sleep for 11 seconds 00000100:00100000:0.0:1787430667.315421:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700224 00000100:00100000:0.0:1787430667.315431:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700224 00000100:00100000:0.0:1787430667.315525:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430667.315536:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006701fb97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6473:x1874256847700224:12345-0@lo:253: 20000000:01000000:0.0:1787430667.315580:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430667.315583:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787430667.316063:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787430667.316159:0:6492:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787430667.316663:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430667.317972:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787430667.318323:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430667.318327:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787430667.318332:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787430667.318335:0:6492:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787430667.318407:0:6492:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787430667.318842:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430667.319038:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787430667.319064:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787430667.319083:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787430667.319108:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787430667.319124:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787430667.319191:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787430667.319200:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787430667.319214:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787430667.319219:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787430667.319230:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787430667.319235:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787430667.319246:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787430667.319260:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787430667.319285:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787430667.319290:0:6492:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787430667.319298:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430667.319400:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787430667.319410:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787430667.319424:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787430667.319438:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787430667.319452:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787430667.319460:0:6492:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787430667.319484:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787430667.319492:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787430667.319516:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787430667.319532:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787430667.319546:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787430667.319555:0:6492:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787430667.319577:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787430667.319585:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787430667.319597:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787430667.319645:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787430667.319717:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787430667.319738:0:6492:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787430667.319745:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787430667.323379:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787430667.323955:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787430667.323983:0:6492:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.125@tcp for mdt 20000000:01000000:1.0:1787430667.323986:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787430667.324002:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787430667.324010:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787430667.324022:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787430667.324028:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:1.0:1787430667.324039:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787430667.324127:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787430667.324144:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787430667.324158:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787430667.324200:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787430667.324203:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787430667.324207:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787430667.324270:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787430667.324273:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787430667.325233:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787430667.325444:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787430667.325468:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787430667.325483:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787430667.325494:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787430667.325495:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787430667.325946:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787430667.326149:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787430667.326168:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787430667.326242:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787430667.326255:0:6492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787430667.326257:0:6492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787430667.326263:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787430667.326264:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787430667.326269:0:6492:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787430667.326274:0:6492:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787430667.327519:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787430667.327697:0:6492:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787430667.336330:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787430667.336381:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787430667.336395:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787430667.336414:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787430667.336438:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336455:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336464:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336470:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336476:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336482:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336488:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000052662ee already unused, calling callback (0000000074f17fb3) 00010000:00010000:0.0:1787430667.336492:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336510:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336522:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336529:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.336534:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93ac2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430667.336550:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787430667.343245:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006701fb97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6473:x1874256847700224:12345-0@lo:253: Request processed in 27704us (28185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430667.343260:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430667.343357:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000313c3a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700224:0@lo:253: 10000000:01000000:3.0:1787430667.343369:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787430667.343371:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787430667.343373:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787430667.343374:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430667.343374:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787430667.343375:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430667.343376:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430667.343377:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787430667.343378:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787430667.343379:0:6473:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787430667.343380:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430667.343380:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787430667.343394:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a615f07c from lustre-MDT0000 10000000:01000000:3.0:1787430667.343417:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787430667.343419:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787430667.343422:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e2c10964d28 10000000:01000000:3.0:1787430667.343424:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430667.343430:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e2c10964d28 from 1 10000000:01000000:3.0:1787430667.343432:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787430667.343459:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.343466:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.343481:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430667.343496:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000313c3a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700352:0@lo:101: 00000100:00100000:3.0:1787430667.343525:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.343588:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025782a06 going to sleep for 11 seconds 00000100:00100000:0.0:1787430667.343774:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700352 00000100:00100000:0.0:1787430667.343781:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700352 00000100:00100000:0.0:1787430667.343861:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430667.343870:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001e8d9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6473:x1874256847700352:12345-0@lo:101: 00010000:00010000:0.0:1787430667.343882:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430667.343894:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ac9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.343915:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.343924:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.343943:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f744fdbe, rc 0) 00000100:00100000:0.0:1787430667.343986:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001e8d9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:6473:x1874256847700352:12345-0@lo:101: Request processed in 117us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430667.343999:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430667.344045:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000313c3a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700352:0@lo:101: 00010000:00010000:1.0:1787430667.344067:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.344076:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430667.344136:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700480:0@lo:501: 00000100:00100000:1.0:1787430667.344162:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.344938:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700480 00000100:00100000:3.0:1787430667.344945:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700480 00000100:00100000:3.0:1787430667.344971:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430667.344976:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000795522a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:6473:x1874256847700480:12345-0@lo:501: 00000100:00100000:3.0:1787430667.345062:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000795522a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:6473:x1874256847700480:12345-0@lo:501: Request processed in 86us (900us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430667.345068:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430667.345300:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c66844a going to sleep for 11 seconds 00000100:00100000:1.0:1787430667.345317:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700480:0@lo:501: 10000000:01000000:1.0:1787430667.345357:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787430667.345368:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.345376:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430667.345385:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2c04f2d000 10000000:01000000:1.0:1787430667.345389:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787430667.345394:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e2c04f2d000 10000000:01000000:1.0:1787430667.345396:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787430667.345399:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e2c04f2d000 from 1 10000000:01000000:1.0:1787430667.345401:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787430667.345420:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000af0033f5/0x4dbb683ba6a93ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.345426:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000af0033f5/0x4dbb683ba6a93ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.345434:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000af0033f5/0x4dbb683ba6a93ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430667.345446:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700608:0@lo:101: 00000100:00100000:1.0:1787430667.345469:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430667.345479:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c66844a going to sleep for 11 seconds 00000100:00100000:3.0:1787430667.345579:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700608 00000100:00100000:3.0:1787430667.345583:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700608 00000100:00100000:3.0:1787430667.345625:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430667.345630:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000660719ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:6473:x1874256847700608:12345-0@lo:101: 00010000:00010000:3.0:1787430667.345637:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430667.345647:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de55e853/0x4dbb683ba6a93ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ad7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.345659:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de55e853/0x4dbb683ba6a93ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ad7 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.345666:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de55e853/0x4dbb683ba6a93ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ad7 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.345672:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de55e853, rc 0) 00000100:00100000:3.0:1787430667.345714:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000660719ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+7:6473:x1874256847700608:12345-0@lo:101: Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430667.345719:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430667.345799:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700608:0@lo:101: 00010000:00010000:1.0:1787430667.345808:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000af0033f5/0x4dbb683ba6a93ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.345819:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000af0033f5/0x4dbb683ba6a93ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430667.345906:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787430667.345917:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000af0033f5/0x4dbb683ba6a93ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.345923:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000af0033f5/0x4dbb683ba6a93ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430667.345928:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787430667.345931:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787430667.345934:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e2c04f2d000 10000000:01000000:1.0:1787430667.345936:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787430667.345938:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787430667.345940:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787430667.345950:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.345956:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.345961:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430667.345970:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700736:0@lo:101: 00000100:00100000:1.0:1787430667.346112:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430667.346134:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c66844a going to sleep for 11 seconds 00000100:00100000:3.0:1787430667.346180:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700736 00000100:00100000:3.0:1787430667.346185:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700736 00000100:00100000:3.0:1787430667.346212:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430667.346218:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fba329a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+7:6473:x1874256847700736:12345-0@lo:101: 00010000:00010000:3.0:1787430667.346224:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430667.346230:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ae5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.346242:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 8 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.346249:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 8 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.346255:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000093ceb3e4, rc 0) 00000100:00100000:3.0:1787430667.346279:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fba329a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+8:6473:x1874256847700736:12345-0@lo:101: Request processed in 62us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430667.346286:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430667.346405:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700736:0@lo:101: 00010000:00010000:1.0:1787430667.346414:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.346420:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430667.346458:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700864:0@lo:501: 00000100:00100000:1.0:1787430667.346477:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430667.346493:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c66844a going to sleep for 11 seconds 00000100:00100000:3.0:1787430667.346531:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700864 00000100:00100000:3.0:1787430667.346535:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700864 00000100:00100000:3.0:1787430667.346558:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430667.346562:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c17b1c59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+8:6473:x1874256847700864:12345-0@lo:501: 00000100:00100000:3.0:1787430667.346662:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c17b1c59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6473:x1874256847700864:12345-0@lo:501: Request processed in 100us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430667.346668:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430667.346759:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700864:0@lo:501: 00000100:00100000:1.0:1787430667.346783:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700992:0@lo:503: 00000100:00100000:1.0:1787430667.346817:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430667.346837:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c66844a going to sleep for 11 seconds 00000100:00100000:3.0:1787430667.346882:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847700992 00000100:00100000:3.0:1787430667.346891:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847700992 00000100:00100000:3.0:1787430667.346920:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430667.346926:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0fb0fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6473:x1874256847700992:12345-0@lo:503: 00000100:00100000:3.0:1787430667.347037:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0fb0fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6473:x1874256847700992:12345-0@lo:503: Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430667.347046:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430667.347216:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847700992:0@lo:503: 00000100:00100000:3.0:1787430667.347540:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068f6686c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6519:1874256847701120:0@lo:502: 00000100:00100000:3.0:1787430667.347574:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.347594:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2550a19 going to sleep for 11 seconds 00000100:00100000:1.0:1787430667.347664:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847701120 00000100:00100000:1.0:1787430667.347667:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847701120 00000100:00100000:1.0:1787430667.347706:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430667.347715:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c10b90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6519:x1874256847701120:12345-0@lo:502: 00000100:00100000:1.0:1787430667.347845:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c10b90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6519:x1874256847701120:12345-0@lo:502: Request processed in 130us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.347853:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787430667.347955:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068f6686c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6519:1874256847701120:0@lo:502: 00000020:01000000:2.0:1787430667.347975:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430667.347986:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430667.348042:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787430667.348047:0:6519:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787430667.348098:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430667.348112:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f1748154) 00000020:00000080:2.0:1787430667.348130:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787430667.348136:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787430667.348223:0:6519:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787430667.348230:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93afa 00000020:00000080:2.0:1787430667.348397:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787430667.348400:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430667.348403:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430667.348404:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787430667.348405:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430667.348407:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430667.348408:0:6519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787430667.348410:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430667.348415:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001080a076) 00000020:00000080:2.0:1787430667.348421:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787430667.348423:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787430667.348424:0:6519:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787430667.348426:0:6519:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787430667.348430:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787430667.348454:0:6519:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a615f07c from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787430667.348466:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000325c1b22) 00000020:00000080:2.0:1787430667.348470:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787430667.348511:0:6519:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787430667.348515:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a93b0f 00000020:00000080:2.0:1787430667.348574:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787430667.348578:0:6519:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787430667.348580:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4dbb683ba6a93b16 00080000:01000000:2.0:1787430667.348583:0:6519:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787430667.348585:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93b1d 00080000:10000000:2.0:1787430667.349112:0:6519:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787430667.349248:0:6519:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787430667.352986:0:6519:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787430667.406531:0:6519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787430667.407180:0:6519:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787430667.410908:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787430667.411350:0:6519:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787430667.413893:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000062516c0a) 00000020:00000080:3.0:1787430667.413914:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787430667.413991:0:6519:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787430667.413998:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93b2b 00000020:00000080:2.0:1787430667.414763:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787430667.415798:0:6519:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787430667.418015:0:6519:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1787430667.421874:0:6519:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.424854:0:6519:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.429543:0:6519:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.432964:0:6519:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787430667.439390:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4dbb683ba6a93b32 00000020:00000080:3.0:1787430667.439918:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787430667.439929:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430667.439935:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430667.439937:0:6519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787430667.439940:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430667.439944:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430667.439946:0:6519:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430667.439949:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430667.439956:0:6519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787430667.439959:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430667.439962:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430667.439963:0:6519:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787430667.439965:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430667.439970:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430667.439972:0:6519:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787430667.439976:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787430667.440015:0:6519:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787430667.440070:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6519:1874256847701248:0@lo:502: 00000100:00100000:3.0:1787430667.440164:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.440209:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec72f282 going to sleep for 11 seconds 00000100:00100000:1.0:1787430667.440269:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847701248 00000100:00100000:1.0:1787430667.440276:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847701248 00000100:00100000:1.0:1787430667.440317:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430667.440325:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ca88ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6519:x1874256847701248:12345-0@lo:502: 00000100:00100000:1.0:1787430667.440442:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ca88ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6519:x1874256847701248:12345-0@lo:502: Request processed in 117us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.440450:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430667.440542:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6519:1874256847701248:0@lo:502: 00000020:01000000:3.0:1787430667.440570:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430667.440574:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430667.440576:0:6519:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787430667.440579:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787430667.440771:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787430667.440789:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787430667.440807:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.440818:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430667.440825:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c04f2d000 from 1 10000000:01000000:1.0:1787430667.440832:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787430667.440855:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.440862:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.440871:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430667.440882:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701376:0@lo:101: 00000100:00100000:1.0:1787430667.440909:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430667.441008:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000002baf1ce9 going to sleep for 11 seconds 00000100:00100000:2.0:1787430667.441111:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847701376 00000100:00100000:2.0:1787430667.441117:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847701376 00000100:00100000:2.0:1787430667.441179:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787430667.441187:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0810720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:6473:x1874256847701376:12345-0@lo:101: 00010000:00010000:2.0:1787430667.441195:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430667.441209:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93b39 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430667.441227:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430667.441237:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430667.441245:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000984f68d7, rc 0) 00000100:00100000:2.0:1787430667.441292:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0810720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:6473:x1874256847701376:12345-0@lo:101: Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430667.441298:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430667.441352:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008474660d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701376:0@lo:101: 00010000:00010000:3.0:1787430667.441362:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.441370:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430667.441915:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701504:0@lo:256: 00000100:00100000:3.0:1787430667.441950:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.442134:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000208b2984 going to sleep for 11 seconds 00000100:00100000:1.0:1787430667.442166:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847701504 00000100:00100000:1.0:1787430667.442171:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847701504 00000100:00100000:1.0:1787430667.442195:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430667.442201:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017702696 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:6473:x1874256847701504:12345-0@lo:256: 20000000:01000000:1.0:1787430667.442220:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787430667.442225:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787430667.444640:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017702696 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:6473:x1874256847701504:12345-0@lo:256: Request processed in 2431us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.444655:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430667.444841:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701504:0@lo:256: 10000000:01000000:3.0:1787430667.445352:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430667.445387:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.445399:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430667.445408:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c04f2d000 from 1 10000000:01000000:3.0:1787430667.445411:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430667.445440:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.445447:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.445455:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430667.445472:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701632:0@lo:101: 00000100:00100000:3.0:1787430667.445509:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.445579:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000208b2984 going to sleep for 11 seconds 00000100:00100000:2.0:1787430667.445645:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847701632 00000100:00100000:2.0:1787430667.445653:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847701632 00000100:00100000:1.0:1787430667.445768:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787430667.445778:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d3b43d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:6473:x1874256847701632:12345-0@lo:101: 00010000:00010000:1.0:1787430667.445790:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430667.445804:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93b47 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.445824:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.445832:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.445839:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f8384bdc, rc 0) 00000100:00100000:1.0:1787430667.445911:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d3b43d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6473:x1874256847701632:12345-0@lo:101: Request processed in 135us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.445918:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430667.446045:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701632:0@lo:101: 00010000:00010000:3.0:1787430667.446057:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.446065:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430667.446116:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701760:0@lo:501: 00000100:00100000:3.0:1787430667.446141:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.446202:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000208b2984 going to sleep for 11 seconds 00000100:00100000:1.0:1787430667.446234:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847701760 00000100:00100000:1.0:1787430667.446239:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847701760 00000100:00100000:1.0:1787430667.446268:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787430667.446275:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af79fc83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6473:x1874256847701760:12345-0@lo:501: 00000100:00100000:1.0:1787430667.446457:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af79fc83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6473:x1874256847701760:12345-0@lo:501: Request processed in 183us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.446465:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787430667.446541:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701760:0@lo:501: 00000100:00100000:3.0:1787430667.446565:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701888:0@lo:503: 00000100:00100000:3.0:1787430667.446686:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.446713:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000208b2984 going to sleep for 11 seconds 00000100:00100000:0.0:1787430667.446758:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847701888 00000100:00100000:0.0:1787430667.446762:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847701888 00000100:00100000:0.0:1787430667.446795:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430667.446802:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078cafe82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6473:x1874256847701888:12345-0@lo:503: 00000040:00080000:0.0:1787430667.446833:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430667.446873:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078cafe82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6473:x1874256847701888:12345-0@lo:503: Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430667.446879:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430667.446984:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847701888:0@lo:503: 00000040:00080000:0.0:1787430667.447739:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787430667.447800:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787430667.447831:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430667.447849:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.447859:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430667.447902:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787430667.447905:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2c04f2d000 10000000:01000000:3.0:1787430667.447908:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2c04f2d000 10000000:01000000:3.0:1787430667.447912:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430667.447917:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c04f2d000 from 1 10000000:01000000:3.0:1787430667.447920:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787430667.447944:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.447952:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.447959:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430667.447973:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702016:0@lo:101: 00000100:00100000:3.0:1787430667.448017:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.448077:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be9f2500 going to sleep for 11 seconds 00000100:00100000:1.0:1787430667.448117:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702016 00000100:00100000:1.0:1787430667.448123:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702016 00000100:00100000:1.0:1787430667.448163:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430667.448170:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032320ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6473:x1874256847702016:12345-0@lo:101: 00010000:00010000:1.0:1787430667.448180:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430667.448191:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93b55 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.448208:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.448216:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.448224:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c2d2fa0, rc 0) 00000100:00100000:1.0:1787430667.448298:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032320ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6473:x1874256847702016:12345-0@lo:101: Request processed in 127us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.448304:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787430667.448461:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702016:0@lo:101: 00010000:00010000:3.0:1787430667.448472:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.448480:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430667.448523:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702144:0@lo:501: 00000100:00100000:3.0:1787430667.448546:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.448567:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be9f2500 going to sleep for 11 seconds 00000100:00100000:2.0:1787430667.448585:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702144 00000100:00100000:2.0:1787430667.448590:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702144 00000100:00100000:2.0:1787430667.448646:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430667.448652:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d2a0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6473:x1874256847702144:12345-0@lo:501: 00000100:00100000:2.0:1787430667.448778:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d2a0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6473:x1874256847702144:12345-0@lo:501: Request processed in 127us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430667.448783:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787430667.448805:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702144:0@lo:501: 00000100:00100000:3.0:1787430667.448832:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702272:0@lo:503: 00000100:00100000:3.0:1787430667.448867:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.448892:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be9f2500 going to sleep for 11 seconds 00000100:00100000:2.0:1787430667.448907:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702272 00000100:00100000:2.0:1787430667.448970:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702272 00000100:00100000:2.0:1787430667.448992:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430667.448998:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef7b051 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6473:x1874256847702272:12345-0@lo:503: 00000100:00100000:2.0:1787430667.449062:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef7b051 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6473:x1874256847702272:12345-0@lo:503: Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430667.449067:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430667.449155:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702272:0@lo:503: 00000100:00100000:0.0:1787430667.449398:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000806123f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6524:1874256847702400:0@lo:502: 00000100:00100000:0.0:1787430667.449441:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430667.449463:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2ffc8b5 going to sleep for 11 seconds 00000100:00100000:2.0:1787430667.449556:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702400 00000100:00100000:2.0:1787430667.449560:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702400 00000100:00100000:2.0:1787430667.449646:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430667.449653:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb93146a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6524:x1874256847702400:12345-0@lo:502: 00000100:00100000:2.0:1787430667.449746:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb93146a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6524:x1874256847702400:12345-0@lo:502: Request processed in 93us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430667.449754:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787430667.449761:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000806123f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6524:1874256847702400:0@lo:502: 00000020:01000004:3.0:1787430667.449820:0:6524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787430667.449842:0:6524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cb40211a) 00000020:00000080:3.0:1787430667.449860:0:6524:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787430667.449936:0:6524:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a615f07c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787430667.449940:0:6524:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a615f07c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787430667.449942:0:6524:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a615f07c 4 00010000:00080000:3.0:1787430667.449969:0:6524:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052aa28ac@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1787430667.452466:0:6524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787430667.452826:0:6524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787430667.452874:0:6524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787430667.452888:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4dbb683ba6a93b6a 00000100:00080000:3.0:1787430667.452899:0:6524:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430667.452904:0:6524:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052aa28ac using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430667.452937:0:6524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b6fda9a3 x1874256847702528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430667.452993:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847702528:0@lo:38: 00000100:00100000:1.0:1787430667.453062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430667.453857:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702528 00000100:00100000:0.0:1787430667.453864:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702528 00000100:00100000:0.0:1787430667.453898:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430667.453903:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017581e35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847702528:12345-0@lo:38: 00000100:00080000:3.0:1787430667.454688:0:6524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787430667.455417:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002416cc03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6524:1874256847702656:0@lo:502: 00000100:00100000:0.0:1787430667.455612:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017581e35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847702528:12345-0@lo:38: Request processed in 1694us (2537us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787430667.455622:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430667.455671:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430667.455689:0:3626:0:(import.c:65:import_set_state_nolock()) 0000000052aa28ac lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787430667.455694:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787430667.455698:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6fda9a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847702528:0@lo:38: 00000100:00100000:2.0:1787430667.456830:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430667.456886:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set 00000000247060f9 going to sleep for 11 seconds 00000100:00100000:0.0:1787430667.457072:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702656 00000100:00100000:0.0:1787430667.457080:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702656 00000100:00100000:0.0:1787430667.457163:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430667.457173:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c59202eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6524:x1874256847702656:12345-0@lo:502: 00000100:00100000:0.0:1787430667.457314:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c59202eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6524:x1874256847702656:12345-0@lo:502: Request processed in 143us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430667.457322:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430667.457402:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002416cc03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6524:1874256847702656:0@lo:502: 00000040:00080000:2.0:1787430667.457439:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787430667.457542:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787430667.457566:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787430667.457590:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430667.457622:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787430667.457673:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787430667.457676:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787430667.457688:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430667.457690:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430667.457691:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430667.457693:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430667.457694:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787430667.457696:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787430667.457697:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787430667.457699:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787430667.457701:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430667.457703:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787430667.457706:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787430667.457709:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787430667.457711:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787430667.457713:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430667.457714:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430667.457720:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430667.457722:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430667.457723:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787430667.457723:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787430667.457724:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787430667.457725:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787430667.457726:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430667.457727:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787430667.457746:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787430667.457761:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077267576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702784:0@lo:253: 00000100:00100000:3.0:1787430667.457997:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.458019:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000208b2984 going to sleep for 11 seconds 00000100:00100000:2.0:1787430667.458034:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702784 00000100:00100000:2.0:1787430667.458040:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702784 00000100:00100000:2.0:1787430667.458074:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430667.458082:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012a5eaa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6473:x1874256847702784:12345-0@lo:253: 20000000:01000000:2.0:1787430667.458101:0:6489:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787430667.458115:0:6489:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787430667.465385:0:6489:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787430667.465576:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787430667.465715:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787430667.465720:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787430667.465739:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.465757:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.465765:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.465803:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430667.465816:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 12 pid: 6489 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430667.465829:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ad950e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847702912:0@lo:104: 00000100:00100000:0.0:1787430667.465867:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430667.465892:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012a5eaa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6473:x1874256847702784:12345-0@lo:253: Request processed in 7810us (7895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430667.465902:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787430667.465912:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000009154a796 going to sleep for 11 seconds 00000100:00100000:1.0:1787430667.465918:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847702912 00000100:00100000:1.0:1787430667.465926:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847702912 00000100:00100000:1.0:1787430667.465979:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430667.465988:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081081d6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847702912:12345-0@lo:104: 00010000:00010000:1.0:1787430667.466010:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.466064:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430667.466071:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081081d6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847702912:12345-0@lo:104: Request processed in 84us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.466079:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430667.466094:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ad950e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847702912:0@lo:104: 00010000:00010000:1.0:1787430667.466110:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430667.466116:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.466124:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002fbd09e9 already unused, calling callback (0000000054dd2675) 00010000:00010000:2.0:1787430667.466125:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430667.466128:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.466144:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430667.466151:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430667.466157:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430667.466186:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.466193:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430667.466206:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.466211:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b40 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.466236:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430667.466238:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430667.466240:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430667.466360:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430667.466370:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c397ea92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847703040:0@lo:103: 00000100:00100000:3.0:1787430667.466403:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430667.466446:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077267576 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6473:1874256847702784:0@lo:253: 10000000:01000000:3.0:1787430667.466456:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787430667.466459:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787430667.466461:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787430667.466462:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430667.466463:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430667.466464:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430667.466466:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430667.466467:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787430667.466468:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787430667.466469:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787430667.466470:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787430667.466472:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430667.466473:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787430667.466487:0:6473:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787430667.469776:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703040 00000100:00100000:1.0:1787430667.469788:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703040 00010000:00010000:1.0:1787430667.469825:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 12 pid: 6489 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430667.469874:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430667.469884:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9c801d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:3627:x1874256847703040:12345-0@lo:103: 00010000:00010000:1.0:1787430667.469898:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430667.469903:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 12 pid: 6489 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.469916:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 12 pid: 6489 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.469934:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000984f68d7/0x4dbb683ba6a93b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93b39 expref: 12 pid: 6489 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.469952:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.469959:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787430667.469975:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004255795s 00010000:00010000:1.0:1787430667.469979:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.469997:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.470003:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.470010:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.470017:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000052662ee already unused, calling callback (0000000074f17fb3) 00010000:00010000:1.0:1787430667.470021:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.470028:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.470048:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430667.470059:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430667.470140:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9c801d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:3627:x1874256847703040:12345-0@lo:103: Request processed in 258us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430667.470148:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787430667.470200:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430667.470211:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430667.470217:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000052662ee/0x4dbb683ba6a93b71 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430667.470499:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c397ea92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847703040:0@lo:103: 00080000:10000000:3.0:1787430667.470531:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.470827:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787430667.471079:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.471309:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787430667.471492:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.471749:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787430667.472902:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.473060:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787430667.473262:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.473437:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787430667.473821:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787430667.473992:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1787430667.476392:0:6473:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787430667.489491:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787430667.489856:0:6530:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787430667.491282:0:6529:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787430667.491290:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1787430667.492773:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430667.497037:0:6530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:3.0:1787430667.497595:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787430667.497887:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787430667.498227:0:6530:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787430667.498231:0:6530:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:3.0:1787430667.498597:0:6473:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787430667.498752:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787430667.498893:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787430667.499970:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787430667.500916:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787430667.500953:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787430667.501229:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787430667.501423:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1787430667.502022:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787430667.502215:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787430667.502341:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787430667.502450:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787430667.502560:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787430667.502826:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787430667.502941:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787430667.503044:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787430667.503223:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787430667.503350:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787430667.503463:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787430667.503566:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787430667.503904:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787430667.504032:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787430667.504247:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787430667.504376:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787430667.504809:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787430667.504955:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787430667.505087:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787430667.505284:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787430667.505393:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787430667.505511:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787430667.505699:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787430667.505813:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787430667.505919:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787430667.506028:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787430667.506211:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787430667.506349:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787430667.506481:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787430667.506787:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787430667.506905:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787430667.507020:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787430667.507272:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787430667.509931:0:6473:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787430667.509976:0:6473:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9cc941c7b988 00100000:10000000:3.0:1787430667.509984:0:6473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787430667.510648:0:6473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787430667.510665:0:6473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787430667.510693:0:6473:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787430667.510716:0:6473:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787430667.511394:0:6473:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430667.511570:0:6473:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787430668.288434:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430669.311827:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430670.341929:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787430670.526738:0:6774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1787430671.199376:0:6826:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430671.199558:0:6826:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787430671.361134:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430672.384013:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430672.640020:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002416cc03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847703168:0@lo:400: 00000100:00100000:3.0:1787430672.640137:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430672.640287:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703168 00000100:00100000:0.0:1787430672.640298:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703168 00000100:00100000:0.0:1787430672.640358:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787430672.640368:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b860c55c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:3629:x1874256847703168:12345-0@lo:400: 00000100:00080000:2.0:1787430672.640526:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787430672.640548:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430672.640551:0:38:0:(import.c:65:import_set_state_nolock()) 0000000052aa28ac lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430672.640558:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052aa28ac using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430672.640587:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002a4ce456 x1874256847703296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430672.641070:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847703296:0@lo:38: 00000100:00100000:1.0:1787430672.641112:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430672.641262:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703296 00000100:00100000:2.0:1787430672.641267:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703296 00000100:00100000:2.0:1787430672.641299:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430672.641305:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008037a53b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847703296:12345-0@lo:38: 00010000:00080000:2.0:1787430672.641328:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:2.0:1787430672.641368:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4dbb683ba6a93b78 00000004:00100000:2.0:1787430672.641419:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787430672.641546:0:6499:0:(import.c:65:import_set_state_nolock()) 000000006510336e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430672.641594:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008037a53b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874256847703296:12345-0@lo:38: Request processed in 288us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430672.641641:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787430672.641696:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002a4ce456 x1874256847703296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430672.641713:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787430672.641725:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787430672.641730:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787430672.641732:0:3626:0:(import.c:65:import_set_state_nolock()) 0000000052aa28ac lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787430672.641737:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847703296:0@lo:38: 00000100:00100000:3.0:1787430672.642127:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002416cc03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847703168:0@lo:400: 00000100:00100000:0.0:1787430672.642131:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b860c55c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:3629:x1874256847703168:12345-0@lo:400: Request processed in 1761us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430672.642143:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:2.0:1787430673.151784:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787430673.151797:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c04f2d000 from 3 10000000:01000000:2.0:1787430673.151804:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787430673.151898:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430673.151916:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430673.151930:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430673.151963:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847703424:0@lo:101: 00000100:00100000:2.0:1787430673.152064:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430673.152175:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad552e0f going to sleep for 11 seconds 00000100:00100000:1.0:1787430673.152392:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703424 00000100:00100000:1.0:1787430673.152402:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703424 00000100:00100000:1.0:1787430673.152474:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430673.152486:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b5742aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6494:x1874256847703424:12345-0@lo:101: 00010000:00010000:1.0:1787430673.152505:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430673.152522:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93b7f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430673.152550:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430673.152562:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430673.152573:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073f3bee7, rc 0) 00000100:00100000:1.0:1787430673.152742:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b5742aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6494:x1874256847703424:12345-0@lo:101: Request processed in 257us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430673.152750:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787430673.152862:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847703424:0@lo:101: 00010000:00010000:2.0:1787430673.152876:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430673.152883:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430673.152933:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847703552:0@lo:256: 00000100:00100000:2.0:1787430673.152966:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430673.153040:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad552e0f going to sleep for 11 seconds 00000100:00100000:0.0:1787430673.153119:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703552 00000100:00100000:0.0:1787430673.153125:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703552 00000100:00100000:0.0:1787430673.153194:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430673.153202:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d97a3e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6494:x1874256847703552:12345-0@lo:256: 20000000:01000000:0.0:1787430673.153218:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787430673.153239:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787430673.153242:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787430673.153349:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d97a3e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6494:x1874256847703552:12345-0@lo:256: Request processed in 148us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430673.153358:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787430673.153426:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847703552:0@lo:256: 10000000:01000000:2.0:1787430673.153470:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787430673.153476:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430673.153491:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430673.407754:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787430673.441499:0:6927:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430673.441734:0:6927:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787430674.431789:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430675.456758:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430676.481295:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430677.503928:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430677.760663:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1373319 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847703680:0@lo:400: 00000100:00100000:1.0:1787430677.760746:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430677.760808:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f6aed6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847703808:0@lo:400: 00000100:00100000:1.0:1787430677.760838:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430677.760890:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703680 00000100:00100000:1.0:1787430677.760898:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703680 00000100:00100000:1.0:1787430677.760944:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430677.760952:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b063cf69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:3630:x1874256847703680:12345-0@lo:400: 00000100:00100000:1.0:1787430677.760997:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b063cf69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:3630:x1874256847703680:12345-0@lo:400: Request processed in 46us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430677.761004:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430677.761038:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703808 00000100:00100000:1.0:1787430677.761042:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703808 00000100:00100000:1.0:1787430677.761068:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430677.761073:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da55b99f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847703808:12345-0@lo:400: 00000100:00100000:1.0:1787430677.761106:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da55b99f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847703808:12345-0@lo:400: Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430677.761113:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787430677.761150:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007f6aed6f x1874256847703808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430677.761165:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f6aed6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847703808:0@lo:400: 00000100:00100000:1.0:1787430677.761190:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1373319 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847703680:0@lo:400: 00010000:00010000:1.0:1787430678.527775:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430679.552826:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787430680.003709:0:7425:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787430680.003713:0:7425:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787430680.003715:0:7425:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787430680.003844:0:7425:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000afaa463e 00000020:01000004:0.0:1787430680.003860:0:7425:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1787430680.003872:0:7425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787430680.003889:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000077159782) 00000020:00000080:0.0:1787430680.003902:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787430680.035396:0:7425:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1787430680.035470:0:7425:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1787430680.047531:0:7425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787430680.047792:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787430680.047803:0:7425:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787430680.047814:0:7425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a93b94 00000020:01000004:0.0:1787430680.047820:0:7425:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787430680.047839:0:7425:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787430680.047842:0:7425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787430680.047847:0:7425:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787430680.047871:0:7425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787430680.047874:0:7425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787430680.059318:0:7425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787430680.059355:0:7425:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1787430680.059360:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787430680.059362:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787430680.059363:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430680.059364:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430680.059365:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430680.059366:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430680.059368:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430680.059369:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430680.059370:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430680.059372:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430680.059373:0:7425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787430680.059376:0:7425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1787430680.059378:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430680.059380:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787430680.059381:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430680.059382:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430680.059383:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430680.059384:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430680.059392:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430680.059393:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430680.059394:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430680.059396:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430680.059397:0:7425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787430680.059423:0:7425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787430680.059441:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847703936:0@lo:253: 00000100:00100000:0.0:1787430680.059514:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.059582:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036aa20b6 going to sleep for 11 seconds 00000100:00100000:2.0:1787430680.059646:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847703936 00000100:00100000:2.0:1787430680.059656:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847703936 00000100:00100000:2.0:1787430680.059709:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787430680.059716:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b8f2ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847703936:12345-0@lo:253: 20000000:01000000:2.0:1787430680.059747:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787430680.059751:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787430680.059756:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787430680.059759:0:6492:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787430680.059793:0:6492:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1787430680.059985:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430680.060087:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787430680.060103:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787430680.060117:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787430680.060130:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787430680.060141:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787430680.060181:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1787430680.060187:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1787430680.060197:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1787430680.060201:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1787430680.060211:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1787430680.060214:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1787430680.060224:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787430680.060249:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787430680.060358:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1787430680.060367:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1787430680.060377:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1787430680.060381:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787430680.060390:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1787430680.060395:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1787430680.060411:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1787430680.060417:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787430680.060429:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787430680.060442:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787430680.060452:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787430680.060528:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1787430680.060538:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1787430680.060550:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787430680.060572:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787430680.060589:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1787430680.060594:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1787430680.060642:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787430680.060660:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787430680.060665:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1787430680.060684:0:6492:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787430680.060691:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1787430680.061943:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787430680.062357:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787430680.062383:0:6492:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.125@tcp for mdt 20000000:01000000:2.0:1787430680.062385:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1787430680.062399:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787430680.062405:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787430680.062417:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787430680.062422:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1787430680.062437:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787430680.062445:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1787430680.062465:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1787430680.062481:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1787430680.062531:0:6492:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1787430680.062540:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1787430680.063319:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1787430680.063464:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787430680.063482:0:6492:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.125@tcp for mdt 20000000:01000000:0.0:1787430680.063485:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:0.0:1787430680.063498:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787430680.063506:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787430680.063518:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787430680.063523:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:0.0:1787430680.063536:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787430680.063542:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1787430680.063555:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787430680.063586:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1787430680.063649:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787430680.063653:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787430680.063658:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787430680.063742:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787430680.063744:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787430680.066454:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787430680.066499:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787430680.066514:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787430680.066682:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787430680.066709:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787430680.066737:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787430680.066751:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787430680.066754:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787430680.068803:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787430680.068835:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787430680.068847:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787430680.069016:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1787430680.069036:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1787430680.069048:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1787430680.069059:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787430680.069062:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787430680.069542:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787430680.069574:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787430680.069591:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787430680.071316:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787430680.071355:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787430680.071369:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787430680.071384:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787430680.071386:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787430680.071391:0:6492:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787430680.071398:0:6492:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787430680.071680:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1787430680.071994:0:6492:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787430680.077927:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787430680.077951:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.077969:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.077976:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.078032:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.078038:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.078074:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.078085:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 12 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430680.078109:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847704064:0@lo:104: 00000100:00100000:2.0:1787430680.078168:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430680.078227:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.078235:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 12 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430680.078242:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d33c9e0f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847704192:0@lo:104: 00000100:00100000:0.0:1787430680.078359:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704064 00000100:00100000:0.0:1787430680.078366:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704064 00000100:00100000:0.0:1787430680.078449:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430680.078459:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004026daf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6492:x1874256847704064:12345-0@lo:104: 00010000:00010000:0.0:1787430680.078470:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.079099:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430680.079104:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004026daf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6492:x1874256847704064:12345-0@lo:104: Request processed in 649us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430680.079110:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787430680.079152:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430680.079157:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.079165:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad4f4f9a already unused, calling callback (0000000054dd2675) 10000000:00010000:1.0:1787430680.079167:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.079188:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430680.079195:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430680.079200:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430680.079236:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.079243:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787430680.079268:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1373319 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847704320:0@lo:103: 00000100:00100000:0.0:1787430680.079299:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430680.079370:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704320 00000100:00100000:3.0:1787430680.079374:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704320 00010000:00010000:3.0:1787430680.079387:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 13 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430680.079409:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430680.079416:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd72cc1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3628:x1874256847704320:12345-0@lo:103: 00010000:00010000:3.0:1787430680.079426:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430680.079429:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 13 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.079439:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 13 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.079455:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430680.079485:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd72cc1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3628:x1874256847704320:12345-0@lo:103: Request processed in 70us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.079491:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787430680.079537:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.079544:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000ad4f4f9a/0x4dbb683ba6a93b55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b5c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.079557:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430680.079558:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430680.079560:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430680.079560:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1373319 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847704320:0@lo:103: 00000100:00100000:2.0:1787430680.079598:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430680.079713:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.079719:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 12 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430680.079724:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847704448:0@lo:104: 00000100:00100000:2.0:1787430680.079739:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430680.079797:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004b69a30 going to sleep for 11 seconds 00010000:00010000:2.0:1787430680.079808:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c2d2fa0/0x4dbb683ba6a93b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93b55 expref: 12 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430680.079818:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4ce456 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847704064:0@lo:104: 00000100:00100000:1.0:1787430680.079868:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704192 00000100:00100000:1.0:1787430680.079871:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704192 00000100:00100000:1.0:1787430680.079885:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704448 00000100:00100000:1.0:1787430680.079887:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704448 00000100:00100000:1.0:1787430680.079894:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430680.079897:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2ba01f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6492:x1874256847704192:12345-0@lo:104: 00010000:00010000:1.0:1787430680.079902:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.079939:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430680.079947:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2ba01f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6492:x1874256847704192:12345-0@lo:104: Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.079951:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430680.079963:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430680.079968:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc915195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6492:x1874256847704448:12345-0@lo:104: 00010000:00010000:1.0:1787430680.079974:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080014:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430680.080018:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc915195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6492:x1874256847704448:12345-0@lo:104: Request processed in 51us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.080023:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787430680.080033:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430680.080035:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080039:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081b613f7 already unused, calling callback (0000000054dd2675) 10000000:00010000:1.0:1787430680.080041:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080045:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430680.080048:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430680.080051:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430680.080063:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080074:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430680.080083:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080086:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93aec expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080092:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430680.080093:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080096:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3a1c361 already unused, calling callback (0000000054dd2675) 10000000:00010000:1.0:1787430680.080097:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080101:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430680.080103:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430680.080106:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430680.080112:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080115:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430680.080116:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080119:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000d3a1c361/0x4dbb683ba6a93ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ad0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080131:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430680.080132:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430680.080133:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430680.080140:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f6aed6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847704576:0@lo:103: 00000100:00100000:1.0:1787430680.080164:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.080181:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430680.080185:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ea9c3c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847704704:0@lo:103: 00000100:00100000:1.0:1787430680.080204:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.080224:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704576 00000100:00100000:1.0:1787430680.080226:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704576 00010000:00010000:1.0:1787430680.080235:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 12 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.080247:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704704 00000100:00100000:1.0:1787430680.080248:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704704 00010000:00010000:1.0:1787430680.080254:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 13 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.080271:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430680.080275:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc69be4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3629:x1874256847704576:12345-0@lo:103: 00010000:00010000:1.0:1787430680.080280:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430680.080282:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 13 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080288:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 13 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080295:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430680.080316:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc69be4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3629:x1874256847704576:12345-0@lo:103: Request processed in 42us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.080321:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430680.080330:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430680.080333:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2830ceb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:3629:x1874256847704704:12345-0@lo:103: 00010000:00010000:1.0:1787430680.080337:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430680.080339:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 12 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080344:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 12 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080350:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080355:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080362:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080366:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080369:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080373:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080375:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c5d3b73b already unused, calling callback (0000000074f17fb3) 00010000:00010000:1.0:1787430680.080381:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080386:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080390:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.080395:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430680.080411:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2830ceb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:3629:x1874256847704704:12345-0@lo:103: Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.080417:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430680.080445:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ea9c3c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847704704:0@lo:103: 00000100:00100000:1.0:1787430680.080453:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f6aed6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847704576:0@lo:103: 00010000:00010000:3.0:1787430680.080495:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430680.080576:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93ae5 expref: 11 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430680.080583:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d33c9e0f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847704192:0@lo:104: 00010000:00010000:2.0:1787430680.080588:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f744fdbe/0x4dbb683ba6a93ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93ac9 expref: 10 pid: 6491 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430680.080631:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847704448:0@lo:104: 00010000:00010000:2.0:1787430680.080647:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.080652:0:6492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.080655:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.080659:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93b9b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787430680.080670:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787430680.084206:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b8f2ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:7425:x1874256847703936:12345-0@lo:253: Request processed in 24481us (24685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.084218:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430680.084288:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847703936:0@lo:253: 10000000:01000000:0.0:1787430680.084299:0:7425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787430680.084302:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787430680.084303:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787430680.084304:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430680.084305:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787430680.084316:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430680.084317:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430680.084318:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430680.084319:0:7425:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787430680.084320:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430680.084321:0:7425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787430680.084338:0:7425:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000afaa463e from lustre-MDT0001 10000000:01000000:0.0:1787430680.084362:0:7425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787430680.084363:0:7425:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787430680.084369:0:7425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e2c10964d28 local copy 10000000:01000000:0.0:1787430680.084372:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787430680.084399:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.084408:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.084416:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.084433:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847704832:0@lo:101: 00000100:00100000:0.0:1787430680.084466:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.084517:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036aa20b6 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.084741:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704832 00000100:00100000:1.0:1787430680.084747:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704832 00000100:00100000:1.0:1787430680.084812:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787430680.084821:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004987f109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+9:7425:x1874256847704832:12345-0@lo:101: 00010000:00010000:1.0:1787430680.084834:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430680.084845:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081b613f7/0x4dbb683ba6a93ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ba2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.084866:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081b613f7/0x4dbb683ba6a93ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ba2 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.084874:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081b613f7/0x4dbb683ba6a93ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ba2 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.084893:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081b613f7, rc 0) 00000100:00100000:1.0:1787430680.084930:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004987f109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:7425:x1874256847704832:12345-0@lo:101: Request processed in 111us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.084936:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787430680.084998:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847704832:0@lo:101: 00010000:00010000:0.0:1787430680.085010:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085019:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.085085:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847704960:0@lo:501: 00000100:00100000:0.0:1787430680.085102:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.085239:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036aa20b6 going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.085327:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847704960 00000100:00100000:3.0:1787430680.085330:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847704960 00000100:00100000:3.0:1787430680.085348:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430680.085351:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dfa348c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:7425:x1874256847704960:12345-0@lo:501: 00000100:00100000:3.0:1787430680.085400:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dfa348c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:7425:x1874256847704960:12345-0@lo:501: Request processed in 48us (296us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430680.085405:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430680.085460:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847704960:0@lo:501: 10000000:01000000:0.0:1787430680.085470:0:7425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787430680.085482:0:7425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787430680.085485:0:7425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085490:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085493:0:7425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085512:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787430680.085529:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2c3a6a2800 10000000:01000000:0.0:1787430680.085532:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787430680.085536:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e2c10964d28 10000000:01000000:0.0:1787430680.085537:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787430680.085539:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e2c10964d28 from 1 10000000:01000000:0.0:1787430680.085540:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787430680.085549:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000008de6901e/0x4dbb683ba6a93bb0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085554:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000008de6901e/0x4dbb683ba6a93bb0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085558:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000008de6901e/0x4dbb683ba6a93bb0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.085574:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705088:0@lo:101: 00000100:00100000:0.0:1787430680.085596:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.085632:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3479f4 going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.085686:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705088 00000100:00100000:3.0:1787430680.085689:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705088 00000100:00100000:3.0:1787430680.085700:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787430680.085703:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058de10c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+10:7425:x1874256847705088:12345-0@lo:101: 00010000:00010000:3.0:1787430680.085708:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430680.085713:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000483eaa17/0x4dbb683ba6a93bb7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93bb0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085721:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000483eaa17/0x4dbb683ba6a93bb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93bb0 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085725:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000483eaa17/0x4dbb683ba6a93bb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93bb0 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085729:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000483eaa17, rc 0) 00000100:00100000:3.0:1787430680.085745:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058de10c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:7425:x1874256847705088:12345-0@lo:101: Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.085749:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1787430680.085765:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430680.085769:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085786:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e2b4288 already unused, calling callback (0000000054dd2675) 10000000:00010000:3.0:1787430680.085788:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085795:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430680.085802:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430680.085808:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430680.085822:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085826:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430680.085837:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085841:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 000000000e2b4288/0x4dbb683ba6a93ba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93ba9 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.085852:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430680.085853:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430680.085854:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430680.085861:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077267576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847705216:0@lo:103: 00000100:00100000:3.0:1787430680.085879:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.085939:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705088:0@lo:101: 00010000:00010000:0.0:1787430680.085945:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000008de6901e/0x4dbb683ba6a93bb0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bb7 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085950:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000008de6901e/0x4dbb683ba6a93bb0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93bb7 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430680.085958:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787430680.085972:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000008de6901e/0x4dbb683ba6a93bb0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bb7 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.085978:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000008de6901e/0x4dbb683ba6a93bb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bb7 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430680.086062:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e2c3a6a2800 10000000:01000000:0.0:1787430680.086064:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787430680.086067:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e2c3a6a2800 from 1 10000000:01000000:0.0:1787430680.086068:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787430680.086077:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000a9d555c0/0x4dbb683ba6a93bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.086081:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000a9d555c0/0x4dbb683ba6a93bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.086084:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000a9d555c0/0x4dbb683ba6a93bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.086090:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705344:0@lo:101: 00000100:00100000:0.0:1787430680.086111:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.086199:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3479f4 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.086238:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705344 00000100:00100000:1.0:1787430680.086241:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705344 00000100:00100000:3.0:1787430680.086308:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787430680.086313:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002deeb04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:7425:x1874256847705344:12345-0@lo:101: 00010000:00010000:3.0:1787430680.086323:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430680.086329:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032ef4d6c/0x4dbb683ba6a93bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93bbe expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.086338:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032ef4d6c/0x4dbb683ba6a93bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93bbe expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.086342:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032ef4d6c/0x4dbb683ba6a93bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93bbe expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.086347:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032ef4d6c, rc 0) 00000100:00100000:3.0:1787430680.086437:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002deeb04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705344:12345-0@lo:101: Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.086443:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430680.086503:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705216 00000100:00100000:1.0:1787430680.086506:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705216 00000100:00100000:1.0:1787430680.086533:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430680.086537:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009149e759 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:3627:x1874256847705216:12345-0@lo:103: 00010000:00010000:1.0:1787430680.086543:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430680.086551:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081b613f7/0x4dbb683ba6a93ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93ba2 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.086559:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430680.086617:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009149e759 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:3627:x1874256847705216:12345-0@lo:103: Request processed in 62us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.086624:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430680.086651:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077267576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847705216:0@lo:103: 00000100:00100000:0.0:1787430680.086664:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705344:0@lo:101: 00010000:00010000:0.0:1787430680.086673:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000a9d555c0/0x4dbb683ba6a93bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.086680:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000a9d555c0/0x4dbb683ba6a93bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430680.086690:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787430680.086702:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000a9d555c0/0x4dbb683ba6a93bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.086709:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000a9d555c0/0x4dbb683ba6a93bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430680.086715:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787430680.086719:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430680.086723:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e2c3a6a2800 10000000:01000000:0.0:1787430680.086725:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787430680.086728:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787430680.086729:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787430680.086741:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000d2f294ee/0x4dbb683ba6a93bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.086748:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000d2f294ee/0x4dbb683ba6a93bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.086765:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000d2f294ee/0x4dbb683ba6a93bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.086782:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705472:0@lo:101: 00000100:00100000:0.0:1787430680.086805:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.086829:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3479f4 going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.086830:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705472 00000100:00100000:3.0:1787430680.086834:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705472 00000100:00100000:3.0:1787430680.086861:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430680.086867:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000762229cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:7425:x1874256847705472:12345-0@lo:101: 00010000:00010000:3.0:1787430680.086873:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430680.086879:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000155260d9/0x4dbb683ba6a93bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93bcc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.086890:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000155260d9/0x4dbb683ba6a93bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.086897:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000155260d9/0x4dbb683ba6a93bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.086903:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000155260d9, rc 0) 00000100:00100000:3.0:1787430680.086934:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000762229cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705472:12345-0@lo:101: Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.086940:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787430680.086973:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705472:0@lo:101: 00010000:00010000:0.0:1787430680.086983:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000d2f294ee/0x4dbb683ba6a93bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.086990:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000d2f294ee/0x4dbb683ba6a93bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.087055:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705600:0@lo:501: 00000100:00100000:0.0:1787430680.087084:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.087135:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3479f4 going to sleep for 11 seconds 00000100:00100000:2.0:1787430680.087293:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705600 00000100:00100000:2.0:1787430680.087298:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705600 00000100:00100000:2.0:1787430680.087329:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787430680.087335:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f72c3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705600:12345-0@lo:501: 00000100:00100000:2.0:1787430680.087433:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f72c3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705600:12345-0@lo:501: Request processed in 98us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.087440:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430680.087458:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705600:0@lo:501: 00000100:00100000:0.0:1787430680.087482:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705728:0@lo:503: 00000100:00100000:0.0:1787430680.087516:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.087555:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3479f4 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.087592:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705728 00000100:00100000:1.0:1787430680.087596:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705728 00000100:00100000:1.0:1787430680.087713:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430680.087718:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef757423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705728:12345-0@lo:503: 00000100:00100000:1.0:1787430680.087795:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef757423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705728:12345-0@lo:503: Request processed in 77us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.087802:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430680.087863:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705728:0@lo:503: 00000040:00080000:0.0:1787430680.088085:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430680.088138:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705856:0@lo:502: 00000100:00100000:0.0:1787430680.088166:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.088285:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3479f4 going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.088361:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705856 00000100:00100000:3.0:1787430680.088365:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705856 00000100:00100000:3.0:1787430680.088387:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430680.088391:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089107da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705856:12345-0@lo:502: 00000100:00100000:3.0:1787430680.088506:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089107da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705856:12345-0@lo:502: Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.088541:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430680.088632:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705856:0@lo:502: 00000040:00080000:0.0:1787430680.088809:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787430680.088830:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1787430680.088838:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1787430680.088845:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1787430680.088852:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1787430680.088858:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1787430680.088865:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1787430680.088871:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1787430680.088877:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1787430680.088884:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1787430680.088891:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1787430680.088898:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1787430680.088904:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1787430680.088910:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1787430680.088917:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1787430680.088923:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1787430680.088929:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1787430680.088937:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1787430680.088944:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1787430680.088950:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1787430680.088957:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1787430680.088974:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1787430680.088983:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1787430680.089002:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705984:0@lo:502: 00000100:00100000:0.0:1787430680.089036:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.089060:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3479f4 going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.089068:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847705984 00000100:00100000:3.0:1787430680.089073:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847705984 00000100:00100000:3.0:1787430680.089101:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787430680.089107:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000132ce98f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705984:12345-0@lo:502: 00000100:00100000:3.0:1787430680.089165:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000132ce98f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847705984:12345-0@lo:502: Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.089171:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430680.089332:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847705984:0@lo:502: 00000040:00080000:0.0:1787430680.089360:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1787430680.089365:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787430680.089784:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430680.089793:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.089796:0:7437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787430680.089801:0:7437:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787430680.089804:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430680.089816:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000028c3d14e) 00000020:00000080:3.0:1787430680.089828:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787430680.089832:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787430680.089892:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787430680.089897:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a93be1 00000020:00000080:3.0:1787430680.090074:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787430680.090077:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430680.090082:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.090083:0:7437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787430680.090085:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430680.090087:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.090088:0:7437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787430680.090090:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430680.090095:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a1804c86) 00000020:00000080:3.0:1787430680.090102:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787430680.090104:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787430680.090106:0:7437:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787430680.090108:0:7437:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787430680.090111:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787430680.090150:0:7437:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000afaa463e from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787430680.090161:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000005e43001e) 00000020:00000080:3.0:1787430680.090168:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787430680.090222:0:7437:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787430680.090226:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a93bf6 00000020:00000080:3.0:1787430680.090298:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787430680.090302:0:7437:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787430680.090305:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4dbb683ba6a93bfd 00080000:01000000:3.0:1787430680.090308:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787430680.090310:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a93c04 00080000:10000000:3.0:1787430680.090597:0:7437:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787430680.090744:0:7437:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787430680.141405:0:7437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787430680.141727:0:7437:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787430680.143911:0:7437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787430680.144306:0:7437:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787430680.155356:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787430680.155368:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430680.155374:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430680.155381:0:7437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787430680.155385:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430680.155392:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430680.155394:0:7437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787430680.155396:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787430680.155402:0:7437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:0.0:1787430680.155430:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430680.155444:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000003b7a5c10) 00000020:00000080:0.0:1787430680.155466:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787430680.155471:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787430680.155541:0:7437:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787430680.155548:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787430680.155571:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a93c12 00010000:00080000:0.0:1787430680.155638:0:7437:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b5bab590@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1787430680.159497:0:7437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1787430680.164337:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787430680.164351:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787430680.164391:0:7437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787430680.164412:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a93c19 00000100:00080000:3.0:1787430680.164422:0:7437:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430680.164427:0:7437:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000b5bab590 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430680.164460:0:7437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e2a875aa x1874256847706112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430680.164499:0:7437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787430680.164557:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430680.164561:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.164574:0:7437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787430680.164578:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787430680.164581:0:7437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787430680.164582:0:7437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787430680.164584:0:7437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787430680.164585:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787430680.164588:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.164589:0:7437:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787430680.164592:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430680.164597:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.164598:0:7437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787430680.164630:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787430680.164662:0:7437:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787430680.164675:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430680.164678:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.164680:0:7437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787430680.164682:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430680.164684:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.164685:0:7437:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430680.164689:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430680.164690:0:7437:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787430680.164719:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430680.164722:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430680.164723:0:7437:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787430680.164726:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1787430680.164891:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2a875aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847706112:0@lo:38: 00000100:00100000:1.0:1787430680.164963:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787430680.165228:0:7425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1787430680.165268:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787430680.165279:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000d2f294ee/0x4dbb683ba6a93bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.165289:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000d2f294ee/0x4dbb683ba6a93bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430680.165297:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a2800 from 1 10000000:01000000:0.0:1787430680.165300:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787430680.165321:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.165328:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.165338:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.165360:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfb5fe1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706368:0@lo:101: 00000100:00100000:0.0:1787430680.165390:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.165408:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000754f5d1a going to sleep for 11 seconds 00000100:00100000:0.0:1787430680.165433:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847706112 00000100:00100000:0.0:1787430680.165439:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847706112 00000100:00100000:0.0:1787430680.165468:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430680.165475:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f6aed6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847706112:12345-0@lo:38: 00010000:00080000:0.0:1787430680.165495:0:6502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:0.0:1787430680.165522:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a93c27 00000004:00100000:0.0:1787430680.165537:0:6502:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787430680.165541:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787430680.165757:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847706240:0@lo:400: 00000100:00100000:1.0:1787430680.165787:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.165859:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847706240 00000100:00100000:0.0:1787430680.165863:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847706240 00000100:00100000:0.0:1787430680.165903:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430680.165910:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ea9c3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847706240:12345-0@lo:400: 00000100:00100000:0.0:1787430680.165953:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ea9c3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847706240:12345-0@lo:400: Request processed in 44us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430680.165960:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787430680.166075:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ae9ac278 x1874256847706240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430680.166089:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae9ac278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847706240:0@lo:400: 00000100:00100000:3.0:1787430680.166175:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847706368 00000100:00100000:3.0:1787430680.166180:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847706368 00000100:00100000:3.0:1787430680.166206:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787430680.166213:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e780d5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:7425:x1874256847706368:12345-0@lo:101: 00010000:00010000:3.0:1787430680.166229:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430680.166240:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93c20 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.166270:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.166280:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.166289:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3a1c361, rc 0) 00000100:00100000:3.0:1787430680.166325:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e780d5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:7425:x1874256847706368:12345-0@lo:101: Request processed in 113us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.166331:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430680.166445:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfb5fe1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706368:0@lo:101: 00010000:00010000:1.0:1787430680.166458:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.166466:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.167081:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706496:0@lo:256: 00000100:00100000:1.0:1787430680.167123:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.167153:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087ac10c5 going to sleep for 11 seconds 00000100:00100000:0.0:1787430680.167223:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847706496 00000100:00100000:0.0:1787430680.167228:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847706496 00000100:00100000:0.0:1787430680.167270:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787430680.167277:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f823b92c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:7425:x1874256847706496:12345-0@lo:256: 20000000:01000000:0.0:1787430680.167291:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787430680.167307:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787430680.167309:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787430680.167381:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f823b92c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:7425:x1874256847706496:12345-0@lo:256: Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430680.167394:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430680.167589:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706496:0@lo:256: 10000000:01000000:1.0:1787430680.168902:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787430680.168918:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.168928:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430680.168936:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a2800 from 1 10000000:01000000:1.0:1787430680.170623:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430680.170665:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.170676:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.170686:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.170707:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706624:0@lo:101: 00000100:00100000:1.0:1787430680.170783:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.170818:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087ac10c5 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.170839:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847706624 00000100:00100000:1.0:1787430680.170846:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847706624 00000100:00100000:1.0:1787430680.170890:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787430680.170899:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f8d8bf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:7425:x1874256847706624:12345-0@lo:101: 00010000:00010000:1.0:1787430680.170912:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430680.170923:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93c35 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.170945:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.170954:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.171077:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f30c660, rc 0) 00000100:00100000:1.0:1787430680.171111:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f8d8bf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:7425:x1874256847706624:12345-0@lo:101: Request processed in 214us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.171125:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787430680.171169:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706624:0@lo:101: 00010000:00010000:1.0:1787430680.171181:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.171189:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.171672:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706752:0@lo:501: 00000100:00100000:1.0:1787430680.171697:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.171717:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087ac10c5 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.171732:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847706752 00000100:00100000:1.0:1787430680.171736:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847706752 00000100:00100000:1.0:1787430680.171826:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787430680.171833:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ce9e719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:7425:x1874256847706752:12345-0@lo:501: 00000100:00100000:1.0:1787430680.171918:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ce9e719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:7425:x1874256847706752:12345-0@lo:501: Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.171925:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787430680.171955:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706752:0@lo:501: 00000100:00100000:1.0:1787430680.172057:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706880:0@lo:503: 00000100:00100000:1.0:1787430680.172093:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.172106:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087ac10c5 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.172120:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847706880 00000100:00100000:1.0:1787430680.172124:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847706880 00000100:00100000:1.0:1787430680.172155:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787430680.172161:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c16585e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:7425:x1874256847706880:12345-0@lo:503: 00000040:00080000:1.0:1787430680.172196:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430680.172410:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c16585e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:7425:x1874256847706880:12345-0@lo:503: Request processed in 250us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.172417:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787430680.172574:0:6502:0:(import.c:65:import_set_state_nolock()) 00000000caa7704c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430680.172644:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f6aed6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1874256847706112:12345-0@lo:38: Request processed in 7169us (7682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430680.172653:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430680.172745:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430680.172753:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787430680.172761:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787430680.172766:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787430680.172768:0:3626:0:(import.c:65:import_set_state_nolock()) 00000000b5bab590 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787430680.172783:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2a875aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847706112:0@lo:38: 00000100:00100000:3.0:1787430680.172884:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5deddac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847707008:0@lo:41: 00000100:00100000:3.0:1787430680.172907:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.172942:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707008 00000100:00100000:1.0:1787430680.172947:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707008 00000100:00100000:1.0:1787430680.173052:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430680.173060:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a875aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1874256847707008:12345-0@lo:41: 00000004:00000024:1.0:1787430680.173081:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787430680.173151:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a875aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1874256847707008:12345-0@lo:41: Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.173157:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430680.173159:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5deddac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847707008:0@lo:41: 00000100:00100000:2.0:1787430680.173199:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005b66b25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847706880:0@lo:503: 00000040:00080000:2.0:1787430680.173450:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430680.173485:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1787430680.173540:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430680.174229:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1787430680.174420:0:7425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787430680.174448:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430680.174469:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.174480:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430680.174533:0:7425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787430680.174536:0:7425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2c3a6a2800 10000000:01000000:1.0:1787430680.174539:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2c3a6a2800 10000000:01000000:1.0:1787430680.174543:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787430680.174548:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c3a6a2800 from 1 10000000:01000000:1.0:1787430680.174551:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787430680.174590:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.174732:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.174740:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.174755:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf26559a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707136:0@lo:101: 00000100:00100000:1.0:1787430680.174798:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.174854:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eab1cb4b going to sleep for 11 seconds 00000100:00100000:2.0:1787430680.174880:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707136 00000100:00100000:2.0:1787430680.174884:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707136 00000100:00100000:2.0:1787430680.174933:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787430680.174939:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d660039b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:7425:x1874256847707136:12345-0@lo:101: 00010000:00010000:2.0:1787430680.174947:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430680.174956:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93c43 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.174974:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.174992:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5d3b73b/0x4dbb683ba6a93c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430680.175001:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5d3b73b, rc 0) 00000100:00100000:2.0:1787430680.175042:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d660039b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707136:12345-0@lo:101: Request processed in 103us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.175049:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787430680.175066:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf26559a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707136:0@lo:101: 00010000:00010000:1.0:1787430680.175077:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.175085:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.175153:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf26559a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707264:0@lo:501: 00000100:00100000:1.0:1787430680.175176:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.175191:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eab1cb4b going to sleep for 11 seconds 00000100:00100000:2.0:1787430680.175197:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707264 00000100:00100000:2.0:1787430680.175201:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707264 00000100:00100000:2.0:1787430680.175254:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430680.175272:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f03952c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707264:12345-0@lo:501: 00000100:00100000:2.0:1787430680.175358:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f03952c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707264:12345-0@lo:501: Request processed in 99us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.175372:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787430680.175399:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf26559a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707264:0@lo:501: 00000100:00100000:1.0:1787430680.175421:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf26559a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707392:0@lo:503: 00000100:00100000:1.0:1787430680.175454:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.175528:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eab1cb4b going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.175558:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707392 00000100:00100000:3.0:1787430680.175572:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707392 00000100:00100000:3.0:1787430680.175590:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787430680.175594:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004864997d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707392:12345-0@lo:503: 00000100:00100000:1.0:1787430680.175703:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004864997d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707392:12345-0@lo:503: Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.175709:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf26559a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707392:0@lo:503: 00000100:00100000:1.0:1787430680.175710:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:2.0:1787430680.175900:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430680.175938:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707520:0@lo:502: 00000100:00100000:2.0:1787430680.175961:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.176037:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707520 00000100:00100000:1.0:1787430680.176042:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707520 00000100:00100000:2.0:1787430680.176047:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029af88a9 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.176069:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787430680.176075:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008577c8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707520:12345-0@lo:502: 00000100:00100000:1.0:1787430680.176147:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008577c8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707520:12345-0@lo:502: Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.176154:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787430680.176194:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707520:0@lo:502: 00000040:00080000:2.0:1787430680.176348:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787430680.176365:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787430680.176372:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787430680.176378:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787430680.176385:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787430680.176391:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787430680.176397:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787430680.176407:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787430680.176413:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787430680.176420:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787430680.176426:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787430680.176433:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787430680.176439:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787430680.176445:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787430680.176451:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787430680.176458:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787430680.176464:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787430680.176471:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787430680.176477:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787430680.176484:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787430680.176491:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787430680.176497:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787430680.176510:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787430680.176517:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787430680.176523:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787430680.176530:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787430680.176537:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787430680.176543:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1787430680.176555:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707648:0@lo:502: 00000100:00100000:2.0:1787430680.176638:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430680.176658:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029af88a9 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.176676:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707648 00000100:00100000:1.0:1787430680.176680:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707648 00000100:00100000:1.0:1787430680.176701:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430680.176707:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003aec665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707648:12345-0@lo:502: 00000100:00100000:1.0:1787430680.176782:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003aec665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707648:12345-0@lo:502: Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.176788:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787430680.176800:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707648:0@lo:502: 00000040:00080000:2.0:1787430680.176833:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787430680.176839:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787430680.177201:0:7443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787430680.177220:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000e64c27bd) 00000020:00000080:2.0:1787430680.177239:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787430680.177332:0:7443:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000afaa463e from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787430680.177335:0:7443:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000afaa463e from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787430680.177338:0:7443:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000afaa463e 3 00010000:00080000:2.0:1787430680.177363:0:7443:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002ad16076@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430680.179043:0:7443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1787430680.179217:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787430680.179253:0:7443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787430680.179264:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4dbb683ba6a93c58 00000100:00080000:2.0:1787430680.179273:0:7443:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430680.179277:0:7443:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000002ad16076 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430680.179309:0:7443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c91efe9a x1874256847707776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430680.179339:0:7443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787430680.179424:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847707776:0@lo:38: 00000100:00100000:3.0:1787430680.179485:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787430680.179828:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1787430680.179966:0:7444:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1787430680.181019:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707776 00000100:00100000:1.0:1787430680.181031:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707776 00000100:00100000:1.0:1787430680.181069:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430680.181076:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a30c3ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847707776:12345-0@lo:38: 00010000:00080000:1.0:1787430680.181101:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:1.0:1787430680.181136:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4dbb683ba6a93c5f 00000004:00100000:1.0:1787430680.181154:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787430680.181186:0:6499:0:(import.c:65:import_set_state_nolock()) 000000000038d5d9 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430680.181572:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a30c3ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874256847707776:12345-0@lo:38: Request processed in 485us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.181581:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1787430680.181627:0:7425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787430680.181668:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430680.181693:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.181704:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000002fbd09e9/0x4dbb683ba6a93c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787430680.181791:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c91efe9a x1874256847707776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430680.181803:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430680.181814:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787430680.181822:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787430680.181830:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787430680.181832:0:3626:0:(import.c:65:import_set_state_nolock()) 000000002ad16076 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000020:01000004:1.0:1787430680.181833:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787430680.181835:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787430680.181836:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:3.0:1787430680.181837:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91efe9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847707776:0@lo:38: 00000020:01000004:1.0:1787430680.181838:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430680.181839:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430680.181840:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430680.181842:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430680.181843:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430680.181844:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430680.181846:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430680.181848:0:7425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430680.181851:0:7425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787430680.181853:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430680.181854:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787430680.181855:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430680.181856:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430680.181857:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430680.181858:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430680.181859:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430680.181860:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430680.181861:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430680.181862:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430680.181863:0:7425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430680.181882:0:7425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787430680.181896:0:7425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050c55ee2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707904:0@lo:253: 00000100:00100000:1.0:1787430680.181936:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.182054:0:7425:0:(client.c:2715:ptlrpc_set_wait()) set 0000000076ad9eea going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.182090:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847707904 00000100:00100000:3.0:1787430680.182095:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847707904 00000100:00100000:3.0:1787430680.182126:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787430680.182132:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001361cd05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707904:12345-0@lo:253: 20000000:01000000:3.0:1787430680.182153:0:6491:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787430680.182167:0:6491:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787430680.183791:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787430680.183851:0:6491:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787430680.183868:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787430680.183982:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787430680.183987:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787430680.184006:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.184022:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.184029:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.184036:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.184074:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.184087:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.184099:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b110b93 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847708032:0@lo:104: 00000100:00100000:0.0:1787430680.184134:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.184176:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708032 00000100:00100000:1.0:1787430680.184183:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708032 00000100:00100000:1.0:1787430680.184243:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430680.184252:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070108578 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847708032:12345-0@lo:104: 00010000:00010000:1.0:1787430680.184270:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430680.184479:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001361cd05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:7425:x1874256847707904:12345-0@lo:253: Request processed in 2346us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.184487:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:0.0:1787430680.188254:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.188288:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 14 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.188303:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847708160:0@lo:104: 00000100:00100000:0.0:1787430680.188362:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.188379:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d551412 going to sleep for 11 seconds 00000100:00100000:2.0:1787430680.188800:0:7425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050c55ee2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:7425:1874256847707904:0@lo:253: 10000000:01000000:2.0:1787430680.188813:0:7425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787430680.188816:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430680.188819:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787430680.188820:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430680.188821:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430680.188822:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430680.188824:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430680.188825:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787430680.188826:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787430680.188828:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787430680.188829:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430680.188831:0:7425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787430680.188844:0:7425:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787430680.189227:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b110b93 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847708032:0@lo:104: 00010000:00010000:1.0:1787430680.189263:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430680.189271:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070108578 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847708032:12345-0@lo:104: Request processed in 5020us (5135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.189280:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430680.189309:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708160 00000100:00100000:1.0:1787430680.189315:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708160 00000100:00100000:1.0:1787430680.189345:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430680.189352:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a817ef31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847708160:12345-0@lo:104: 00010000:00010000:1.0:1787430680.189363:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430680.189453:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847708160:0@lo:104: 00010000:00010000:0.0:1787430680.189473:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189513:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430680.189519:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189526:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee07c7cf already unused, calling callback (0000000054dd2675) 10000000:00010000:3.0:1787430680.189537:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189544:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430680.189550:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430680.189556:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430680.189678:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189686:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430680.189705:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189712:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000ee07c7cf/0x4dbb683ba6a93c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c2e expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189724:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430680.189726:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189732:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b00a3df already unused, calling callback (0000000054dd2675) 10000000:00010000:3.0:1787430680.189734:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.189740:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430680.189755:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430680.189761:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430680.189797:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787430680.189803:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a817ef31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847708160:12345-0@lo:104: Request processed in 451us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.189809:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430680.189829:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b2d8cef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847708288:0@lo:103: 00000100:00100000:1.0:1787430680.189860:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430680.189898:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430680.189908:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708288 00000100:00100000:1.0:1787430680.189911:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708288 00010000:00010000:1.0:1787430680.189927:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.189947:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430680.189979:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e029675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:3630:x1874256847708288:12345-0@lo:103: 00010000:00010000:1.0:1787430680.189990:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430680.189996:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.190005:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.190020:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3a1c361/0x4dbb683ba6a93c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93c20 expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430680.190035:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430680.190061:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e029675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:3630:x1874256847708288:12345-0@lo:103: Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430680.190067:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430680.190090:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b2d8cef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847708288:0@lo:103: 00010000:00010000:3.0:1787430680.190329:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190337:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430680.190356:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190362:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 000000001b00a3df/0x4dbb683ba6a93b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b86 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190376:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430680.190377:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430680.190379:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430680.190422:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000472597d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847708416:0@lo:103: 00000100:00100000:1.0:1787430680.190450:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430680.190569:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708416 00000100:00100000:3.0:1787430680.190575:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708416 00010000:00010000:3.0:1787430680.190593:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 14 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430680.190749:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430680.190756:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000496f5e14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:3627:x1874256847708416:12345-0@lo:103: 00010000:00010000:3.0:1787430680.190765:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430680.190769:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 14 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190777:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 14 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190797:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073f3bee7/0x4dbb683ba6a93b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93b7f expref: 14 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190810:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190817:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787430680.190831:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006844641s 00010000:00010000:3.0:1787430680.190834:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190841:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190847:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190853:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190859:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ee59047 already unused, calling callback (0000000074f17fb3) 00010000:00010000:3.0:1787430680.190863:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190869:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190889:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430680.190908:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430680.190939:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000496f5e14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3627:x1874256847708416:12345-0@lo:103: Request processed in 184us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.190946:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787430680.191096:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.191104:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430680.191110:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ee59047/0x4dbb683ba6a93c66 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430680.191203:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000472597d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847708416:0@lo:103: 00080000:10000000:2.0:1787430680.196475:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1787430680.196687:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787430680.196897:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787430680.197080:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787430680.197530:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787430680.197822:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787430680.200115:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787430680.200387:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787430680.200512:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1787430680.200675:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787430680.200813:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1787430680.200927:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1787430680.202510:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787430680.202513:0:7448:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787430680.202518:0:7448:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787430680.202795:0:7449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1787430680.202845:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d33c9e0f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7449:1874256847708544:0@lo:700: 00000040:01000000:0.0:1787430680.202845:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787430680.202916:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430680.202993:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708544 00000100:00100000:0.0:1787430680.203000:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708544 00000100:00100000:0.0:1787430680.203052:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430680.203061:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a4ce456 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7449:x1874256847708544:12345-0@lo:700: 00000100:00100000:2.0:1787430680.203163:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069c981d6 going to sleep for 11 seconds 00000100:00100000:1.0:1787430680.203442:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef4f5a1a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847708672:0@lo:1000: 00000100:00100000:1.0:1787430680.203474:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430680.203503:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000579db15d going to sleep for 11 seconds 00000040:01000000:0.0:1787430680.203536:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1787430680.203547:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708672 00000100:00100000:2.0:1787430680.203551:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708672 00000100:00100000:2.0:1787430680.203665:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787430680.203673:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d02f0778 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847708672:12345-0@lo:1000: 00000040:00080000:0.0:1787430680.203736:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430680.203746:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d02f0778 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847708672:12345-0@lo:1000: Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.203753:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430680.203806:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef4f5a1a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847708672:0@lo:1000: 00000040:01000000:3.0:1787430680.203832:0:7450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787430680.203851:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9c801d1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847708800:0@lo:700: 00000100:00100000:3.0:1787430680.203877:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430680.203898:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000940f17dd going to sleep for 11 seconds 00000004:00000080:0.0:1787430680.204382:0:7425:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:0.0:1787430680.204398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708800 00000100:00100000:0.0:1787430680.204401:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708800 00000100:00100000:0.0:1787430680.204426:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430680.204433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009149e759 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847708800:12345-0@lo:700: 00000100:00100000:0.0:1787430680.204505:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009149e759 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847708800:12345-0@lo:700: Request processed in 73us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430680.204510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1787430680.204525:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787430680.204720:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430680.205908:0:7425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1787430680.206581:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9c801d1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847708800:0@lo:700: 00000100:00100000:3.0:1787430680.206674:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9c801d1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7450:1874256847708928:0@lo:900: 00000100:00100000:3.0:1787430680.206733:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430680.206890:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000940f17dd going to sleep for 11 seconds 00000040:00080000:0.0:1787430680.207126:0:7425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787430680.207167:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787430680.207457:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787430680.207733:0:7425:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1787430680.207945:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847708928 00000100:00100000:2.0:1787430680.207953:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847708928 00000100:00100000:2.0:1787430680.208000:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430680.208007:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba308e94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7450:x1874256847708928:12345-0@lo:900: 00000100:00100000:2.0:1787430680.208081:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba308e94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7450:x1874256847708928:12345-0@lo:900: Request processed in 73us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.208088:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787430680.208130:0:7450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e9c801d1 x1874256847708928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787430696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430680.208144:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9c801d1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7450:1874256847708928:0@lo:900: 00000100:00100000:2.0:1787430680.208229:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb08d099 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847709056:0@lo:1000: 00000100:00100000:2.0:1787430680.208383:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:1.0:1787430680.208393:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:2.0:1787430680.208417:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035c446aa going to sleep for 11 seconds 00000100:00100000:0.0:1787430680.208474:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847709056 00000100:00100000:0.0:1787430680.208478:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847709056 00000100:00100000:0.0:1787430680.208510:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430680.208517:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b83ff6cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847709056:12345-0@lo:1000: 00100000:10000000:1.0:1787430680.208538:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:0.0:1787430680.208586:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b83ff6cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847709056:12345-0@lo:1000: Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430680.208593:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787430680.208678:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb08d099 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847709056:0@lo:1000: 00000004:00080000:2.0:1787430680.208717:0:7450:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006c06c4a6 with version 0 00100000:10000000:1.0:1787430680.208722:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000020:00100000:2.0:1787430680.208731:0:7450:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787430680.208736:0:7450:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cb08d099 x1874256847709312/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430680.208748:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb08d099 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847709312:0@lo:1000: 00000100:00100000:2.0:1787430680.208848:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:1.0:1787430680.208851:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:2.0:1787430680.208905:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f5f7eba going to sleep for 11 seconds 00100000:10000000:1.0:1787430680.208994:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:0.0:1787430680.209080:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847709312 00000100:00100000:0.0:1787430680.209085:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847709312 00000100:00100000:0.0:1787430680.209160:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430680.209167:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000680fdaa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847709312:12345-0@lo:1000: 00100000:10000000:1.0:1787430680.209178:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787430680.209301:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787430680.209429:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787430680.209575:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787430680.209744:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787430680.209888:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787430680.210025:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787430680.210176:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787430680.210305:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787430680.210464:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787430680.210550:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787430680.212889:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787430680.213176:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787430680.213456:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787430680.214143:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787430680.214415:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787430680.214551:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787430680.214838:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 40000000:02000000:2.0:1787430680.215016:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1787430680.215733:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787430680.216090:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787430680.216354:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787430680.216500:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787430680.216710:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787430680.216922:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787430680.217200:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787430680.217480:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787430680.217819:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787430680.218171:0:7425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787430680.220593:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a4ce456 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7449:x1874256847708544:12345-0@lo:700: Request processed in 17525us (17670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430680.220629:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1787430680.221180:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00010000:00080000:0.0:1787430680.221404:0:7449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d33c9e0f x1874256847708544/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787430696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430680.221420:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d33c9e0f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7449:1874256847708544:0@lo:700: 40000000:02000000:0.0:1787430680.221434:0:7449:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:1.0:1787430680.229744:0:7425:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787430680.229787:0:7425:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9cc941c7b988 00100000:10000000:1.0:1787430680.229795:0:7425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787430680.230251:0:7425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787430680.230296:0:7425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787430680.230315:0:7425:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787430680.230329:0:7425:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787430680.231030:0:7425:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430680.231201:0:7425:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1787430680.232497:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000680fdaa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847709312:12345-0@lo:1000: Request processed in 23326us (23644us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787430680.232512:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1787430680.237699:0:7450:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787430680.237707:0:7450:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787430680.237725:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb08d099 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847709312:0@lo:1000: 00000100:00100000:3.0:1787430680.237806:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024971394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847709440:0@lo:1000: 00000100:00100000:3.0:1787430680.237865:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430680.237917:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000794eff60 going to sleep for 11 seconds 00000100:00100000:3.0:1787430680.240262:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847709440 00000100:00100000:3.0:1787430680.240276:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847709440 00000100:00100000:3.0:1787430680.240331:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430680.240340:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000094f3ef4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847709440:12345-0@lo:1000: 00000100:00100000:3.0:1787430680.240451:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000094f3ef4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7450:x1874256847709440:12345-0@lo:1000: Request processed in 112us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430680.240471:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430680.240517:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024971394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1874256847709440:0@lo:1000: 00000040:00080000:3.0:1787430680.240541:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787430680.240592:0:7450:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ca09a34a with version 1 00000040:00080000:3.0:1787430680.249119:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787430680.249192:0:7450:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787430680.255694:0:7439:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003aafdeda version 1 rpc_version 1 00000020:00100000:3.0:1787430680.255733:0:7439:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787430680.255742:0:7439:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000024971394 x1874256847709696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787430680.255764:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024971394 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7439:1874256847709696:0@lo:1000: 00000100:00100000:3.0:1787430680.255828:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430680.255876:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000940f17dd going to sleep for 11 seconds 00000100:00100000:2.0:1787430680.255986:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847709696 00000100:00100000:2.0:1787430680.255994:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847709696 00000100:00100000:2.0:1787430680.256051:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787430680.256060:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000689e4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7439:x1874256847709696:12345-0@lo:1000: 00000001:00080000:2.0:1787430680.262631:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787430680.262765:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000689e4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7439:x1874256847709696:12345-0@lo:1000: Request processed in 6702us (6932us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787430680.262778:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787430680.263095:0:7439:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787430680.263100:0:7439:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787430680.263117:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024971394 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7439:1874256847709696:0@lo:1000: 00000040:00080000:1.0:1787430680.266290:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430680.271928:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787430680.272012:0:7449:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787430680.272018:0:7449:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1787430680.575794:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430681.599757:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430682.626465:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430682.635044:0:7695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1787430683.223879:0:7747:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430683.224062:0:7747:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787430683.654835:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430684.671810:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787430685.268873:0:7848:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787430685.269231:0:7848:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787430685.440508:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000268a1520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847709824:0@lo:41: 00000100:00100000:1.0:1787430685.440632:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430685.440750:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef4f5a1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847710080:0@lo:400: 00000100:00100000:1.0:1787430685.440809:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430685.440837:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430685.440841:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f3695b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847709952:0@lo:400: 00000100:00100000:1.0:1787430685.440865:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430685.440957:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710080 00000100:00100000:1.0:1787430685.440964:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710080 00000100:00100000:1.0:1787430685.441003:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430685.441012:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2830ceb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847710080:12345-0@lo:400: 00000100:00100000:1.0:1787430685.441058:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2830ceb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847710080:12345-0@lo:400: Request processed in 49us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430685.441066:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430685.441087:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847709952 00000100:00100000:1.0:1787430685.441090:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847709952 00000100:00100000:1.0:1787430685.441111:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430685.441116:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d362b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3630:x1874256847709952:12345-0@lo:400: 00000100:00100000:1.0:1787430685.441145:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d362b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3630:x1874256847709952:12345-0@lo:400: Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430685.441150:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430685.441180:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc69be4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847710208:0@lo:400: 00000100:00100000:1.0:1787430685.441207:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430685.441234:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710208 00000100:00100000:1.0:1787430685.441237:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710208 00000100:00100000:1.0:1787430685.441255:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430685.441262:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e029675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847710208:12345-0@lo:400: 00000100:00100000:1.0:1787430685.441287:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e029675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847710208:12345-0@lo:400: Request processed in 27us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430685.441293:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787430685.441318:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bc69be4f x1874256847710208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430685.441337:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc69be4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847710208:0@lo:400: 00000100:00100000:1.0:1787430685.441359:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f3695b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847709952:0@lo:400: 00010000:00080000:1.0:1787430685.441366:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ef4f5a1a x1874256847710080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430685.441374:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef4f5a1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847710080:0@lo:400: 00000100:00100000:3.0:1787430685.441463:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847709824 00000100:00100000:3.0:1787430685.441467:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847709824 00000100:00100000:3.0:1787430685.441497:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430685.441502:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b42640b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847709824:12345-0@lo:41: 00000004:00000024:3.0:1787430685.441540:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787430685.441575:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b42640b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847709824:12345-0@lo:41: Request processed in 73us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430685.441580:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430685.441623:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000268a1520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847709824:0@lo:41: 00010000:00010000:3.0:1787430685.696199:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787430685.871065:0:7896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1a3bc4f0 20000000:00000080:3.0:1787430685.871084:0:7896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2c35638c00 uarg=0000000000000000 20000000:01000000:3.0:1787430685.871124:0:7896:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787430685.871132:0:7896:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787430685.871137:0:7896:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787430685.871220:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787430685.871234:0:7896:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787430685.874454:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787430685.874800:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787430685.874830:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787430685.874846:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787430685.874865:0:7896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787430685.874883:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430685.874901:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430685.874908:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430685.874914:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430685.874950:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430685.874962:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 12 pid: 6492 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430685.874975:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000268a1520 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1874256847710336:0@lo:104: 00000100:00100000:3.0:1787430685.875044:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430685.875208:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430685.875216:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 12 pid: 6491 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430685.875224:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000034edf6f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1874256847710464:0@lo:104: 00000100:00100000:3.0:1787430685.875245:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set 000000001196bf72 going to sleep for 11 seconds 00000100:00100000:1.0:1787430685.880258:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787430685.880304:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430685.880352:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710336 00000100:00100000:1.0:1787430685.880361:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710336 00000100:00100000:1.0:1787430685.880400:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710464 00000100:00100000:1.0:1787430685.880402:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710464 00000100:00100000:1.0:1787430685.880415:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430685.880422:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088e32ab9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:7896:x1874256847710336:12345-0@lo:104: 00010000:00010000:1.0:1787430685.880441:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880524:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430685.880529:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088e32ab9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:7896:x1874256847710336:12345-0@lo:104: Request processed in 108us (5486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430685.880536:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430685.880576:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430685.880581:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef4f5a1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:7896:x1874256847710464:12345-0@lo:104: 00010000:00010000:1.0:1787430685.880588:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880634:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430685.880650:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef4f5a1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:7896:x1874256847710464:12345-0@lo:104: Request processed in 70us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430685.880655:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787430685.880680:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430685.880685:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880691:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081b613f7 already unused, calling callback (0000000054dd2675) 10000000:00010000:1.0:1787430685.880694:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880700:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430685.880707:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430685.880712:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430685.880740:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880746:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430685.880760:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880766:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 0000000081b613f7/0x4dbb683ba6a93c35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c3c expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880780:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430685.880781:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880796:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000009c6fe22 already unused, calling callback (0000000054dd2675) 10000000:00010000:1.0:1787430685.880798:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880804:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430685.880808:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430685.880813:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430685.880823:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880828:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430685.880840:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880844:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 0000000009c6fe22/0x4dbb683ba6a93b47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93b4e expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.880856:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430685.880857:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430685.880858:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430685.880863:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430685.880875:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f3695b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847710592:0@lo:103: 00000100:00100000:1.0:1787430685.880904:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430685.880946:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc69be4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847710720:0@lo:103: 00000100:00100000:1.0:1787430685.880977:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430685.881006:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710592 00000100:00100000:1.0:1787430685.881009:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710592 00010000:00010000:1.0:1787430685.881026:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 13 pid: 6492 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430685.881046:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710720 00000100:00100000:1.0:1787430685.881050:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710720 00010000:00010000:1.0:1787430685.881059:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 14 pid: 6491 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430685.881071:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430685.881076:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050c55ee2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:3628:x1874256847710592:12345-0@lo:103: 00010000:00010000:1.0:1787430685.881085:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430685.881090:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 14 pid: 6492 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881100:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 14 pid: 6492 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881116:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430685.881140:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050c55ee2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:3628:x1874256847710592:12345-0@lo:103: Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430685.881146:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430685.881156:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430685.881161:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf26559a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3629:x1874256847710720:12345-0@lo:103: 00010000:00010000:1.0:1787430685.881168:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430685.881171:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 13 pid: 6491 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881189:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 13 pid: 6491 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881200:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881207:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881218:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881225:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881230:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881236:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881241:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad4f4f9a already unused, calling callback (0000000074f17fb3) 00010000:00010000:1.0:1787430685.881244:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881251:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881257:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430685.881275:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430685.881300:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf26559a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:3629:x1874256847710720:12345-0@lo:103: Request processed in 139us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430685.881306:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430685.881342:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f3695b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847710592:0@lo:103: 00000100:00100000:1.0:1787430685.881362:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc69be4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847710720:0@lo:103: 00010000:00010000:0.0:1787430685.881471:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f30c660/0x4dbb683ba6a93c3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93c35 expref: 12 pid: 6492 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430685.881483:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000268a1520 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1874256847710336:0@lo:104: 00010000:00010000:0.0:1787430685.881492:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f8384bdc/0x4dbb683ba6a93b4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93b47 expref: 11 pid: 6491 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430685.881498:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000034edf6f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1874256847710464:0@lo:104: 00010000:00010000:0.0:1787430685.881523:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430685.881531:0:7896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430685.881536:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430685.881541:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c6d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430686.719986:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787430687.743717:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787430687.743726:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a2800 from 4 10000000:01000000:2.0:1787430687.743732:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787430687.743780:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000005bae43b5/0x4dbb683ba6a93c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.743791:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000005bae43b5/0x4dbb683ba6a93c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.743801:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000005bae43b5/0x4dbb683ba6a93c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430687.743823:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae4fb266 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847710848:0@lo:101: 00000100:00100000:2.0:1787430687.743890:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.743949:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c084c3f6 going to sleep for 11 seconds 00000100:00100000:3.0:1787430687.743982:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710848 00000100:00100000:3.0:1787430687.743991:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710848 00010000:00010000:1.0:1787430687.744033:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430687.744052:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430687.744061:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cf26416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+11:6494:x1874256847710848:12345-0@lo:101: 00010000:00010000:3.0:1787430687.744076:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430687.744090:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93c74 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.744113:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.744123:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000093ceb3e4/0x4dbb683ba6a93c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.744132:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000093ceb3e4, rc 0) 00000100:00100000:3.0:1787430687.744240:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cf26416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6494:x1874256847710848:12345-0@lo:101: Request processed in 179us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.744247:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787430687.744369:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae4fb266 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847710848:0@lo:101: 00010000:00010000:2.0:1787430687.744398:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000005bae43b5/0x4dbb683ba6a93c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.744406:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000005bae43b5/0x4dbb683ba6a93c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430687.744453:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae4fb266 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847710976:0@lo:256: 00000100:00100000:2.0:1787430687.744482:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.744521:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c084c3f6 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.744642:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847710976 00000100:00100000:1.0:1787430687.744647:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847710976 00000100:00100000:1.0:1787430687.744727:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787430687.744735:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000efc877a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6494:x1874256847710976:12345-0@lo:256: 20000000:01000000:1.0:1787430687.744749:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430687.744766:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430687.744770:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787430687.744876:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000efc877a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6494:x1874256847710976:12345-0@lo:256: Request processed in 142us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.744883:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787430687.745016:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae4fb266 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847710976:0@lo:256: 10000000:01000000:0.0:1787430687.745061:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787430687.745067:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000005bae43b5/0x4dbb683ba6a93c74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430687.745076:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000005bae43b5/0x4dbb683ba6a93c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430687.745084:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430687.745087:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a2800 from 1 10000000:01000000:0.0:1787430687.745090:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430687.745110:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000b7297a32/0x4dbb683ba6a93c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430687.745117:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000b7297a32/0x4dbb683ba6a93c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430687.745124:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000b7297a32/0x4dbb683ba6a93c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430687.745136:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711104:0@lo:101: 00000100:00100000:0.0:1787430687.745165:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.745196:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000017b4eb0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430687.745225:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847711104 00000100:00100000:3.0:1787430687.745231:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847711104 00000100:00100000:3.0:1787430687.745262:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787430687.745269:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d3cb5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+12:6494:x1874256847711104:12345-0@lo:101: 00010000:00010000:3.0:1787430687.745283:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430687.745292:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93c82 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.745306:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.745314:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad4f4f9a/0x4dbb683ba6a93c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.745320:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad4f4f9a, rc 0) 00000100:00100000:3.0:1787430687.745353:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d3cb5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:6494:x1874256847711104:12345-0@lo:101: Request processed in 85us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.745360:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430687.745380:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711104:0@lo:101: 00010000:00010000:0.0:1787430687.745392:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000b7297a32/0x4dbb683ba6a93c82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430687.745399:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000b7297a32/0x4dbb683ba6a93c82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430687.745460:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711232:0@lo:501: 00000100:00100000:0.0:1787430687.745484:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.745518:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000017b4eb0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.745579:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847711232 00000100:00100000:1.0:1787430687.745584:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847711232 00000100:00100000:3.0:1787430687.745685:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430687.745693:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f86d4390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:6494:x1874256847711232:12345-0@lo:501: 00000100:00100000:3.0:1787430687.745811:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f86d4390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:6494:x1874256847711232:12345-0@lo:501: Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.745820:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787430687.745828:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711232:0@lo:501: 00000100:00100000:0.0:1787430687.745855:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711360:0@lo:503: 00000100:00100000:0.0:1787430687.746001:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.746025:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000017b4eb0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.746088:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847711360 00000100:00100000:2.0:1787430687.746093:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847711360 00000100:00100000:2.0:1787430687.746126:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787430687.746133:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b65bf7de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:6494:x1874256847711360:12345-0@lo:503: 00000100:00100000:2.0:1787430687.746225:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b65bf7de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:6494:x1874256847711360:12345-0@lo:503: Request processed in 93us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430687.746232:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787430687.746252:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711360:0@lo:503: 00000100:00100000:0.0:1787430687.746644:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8063:1874256847711488:0@lo:502: 00000100:00100000:0.0:1787430687.746680:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.746708:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af664926 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.746731:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847711488 00000100:00100000:1.0:1787430687.746736:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847711488 00000100:00100000:1.0:1787430687.746809:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787430687.746816:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbd26414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:8063:x1874256847711488:12345-0@lo:502: 00000100:00100000:1.0:1787430687.746910:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbd26414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:8063:x1874256847711488:12345-0@lo:502: Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.746926:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787430687.746982:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005006ffb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8063:1874256847711488:0@lo:502: 00000020:01000000:0.0:1787430687.747002:0:8063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430687.747011:0:8063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430687.747013:0:8063:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787430687.747018:0:8063:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c3a6a2800 00000020:00000080:0.0:1787430687.747021:0:8063:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787430687.747056:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8063:1874256847711616:0@lo:502: 00000100:00100000:0.0:1787430687.747088:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430687.747110:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847711616 00000100:00100000:0.0:1787430687.747113:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aeb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.747116:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847711616 00000100:00100000:1.0:1787430687.747225:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430687.747234:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:8063:x1874256847711616:12345-0@lo:502: 00000100:00100000:1.0:1787430687.747302:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:8063:x1874256847711616:12345-0@lo:502: Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.747309:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787430687.747329:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8063:1874256847711616:0@lo:502: 00000020:01000000:0.0:1787430687.747352:0:8063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430687.747357:0:8063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430687.747359:0:8063:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787430687.747367:0:8063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787430687.747554:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787430687.747572:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430687.747580:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.747591:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430687.747690:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787430687.747693:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c04f2d000 from 21 10000000:01000000:2.0:1787430687.747695:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787430687.747714:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.747727:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.747733:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430687.747742:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711744:0@lo:101: 00000100:00100000:2.0:1787430687.747762:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.747782:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.747853:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847711744 00000100:00100000:1.0:1787430687.747859:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847711744 00000100:00100000:1.0:1787430687.747932:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787430687.747940:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:6494:x1874256847711744:12345-0@lo:101: 00010000:00010000:1.0:1787430687.747949:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430687.747962:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93c90 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.747982:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.747993:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.748001:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013eb000, rc 0) 00000100:00100000:1.0:1787430687.748043:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:6494:x1874256847711744:12345-0@lo:101: Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.748052:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787430687.748118:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711744:0@lo:101: 00010000:00010000:2.0:1787430687.748131:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.748140:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430687.748198:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711872:0@lo:501: 00000100:00100000:2.0:1787430687.748224:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.748370:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:3.0:1787430687.748415:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847711872 00000100:00100000:3.0:1787430687.748420:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847711872 00000100:00100000:3.0:1787430687.748445:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787430687.748452:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:6494:x1874256847711872:12345-0@lo:501: 00000100:00100000:3.0:1787430687.748775:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:6494:x1874256847711872:12345-0@lo:501: Request processed in 323us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.748782:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787430687.748881:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847711872:0@lo:501: 00000100:00100000:2.0:1787430687.748908:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712000:0@lo:503: 00000100:00100000:2.0:1787430687.748948:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.749017:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.749059:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712000 00000100:00100000:1.0:1787430687.749064:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712000 00000100:00100000:1.0:1787430687.749106:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787430687.749113:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:6494:x1874256847712000:12345-0@lo:503: 00000100:00100000:1.0:1787430687.749343:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:6494:x1874256847712000:12345-0@lo:503: Request processed in 230us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.749350:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787430687.749416:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712000:0@lo:503: 00000100:00100000:1.0:1787430687.749922:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8064:1874256847712128:0@lo:502: 00000100:00100000:1.0:1787430687.749957:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430687.750023:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430687.750060:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712128 00000100:00100000:3.0:1787430687.750065:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712128 00000100:00100000:3.0:1787430687.750106:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787430687.750112:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8064:x1874256847712128:12345-0@lo:502: 00000100:00100000:3.0:1787430687.750312:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8064:x1874256847712128:12345-0@lo:502: Request processed in 199us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.750319:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787430687.750395:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8064:1874256847712128:0@lo:502: 00000100:00100000:1.0:1787430687.750437:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8064:1874256847712256:0@lo:502: 00000100:00100000:1.0:1787430687.750466:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430687.750487:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.750553:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712256 00000100:00100000:2.0:1787430687.750565:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712256 00000100:00100000:2.0:1787430687.750642:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787430687.750648:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8064:x1874256847712256:12345-0@lo:502: 00000100:00100000:2.0:1787430687.750710:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8064:x1874256847712256:12345-0@lo:502: Request processed in 61us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430687.750716:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430687.750774:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8064:1874256847712256:0@lo:502: 00000040:00080000:1.0:1787430687.750801:0:8064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787430687.750998:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787430687.751014:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787430687.751021:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.751029:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430687.751036:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430687.751038:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c04f2d000 from 4 10000000:01000000:3.0:1787430687.751040:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430687.751059:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.751064:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.751073:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430687.751085:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712384:0@lo:101: 00000100:00100000:3.0:1787430687.751111:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.751242:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430687.751274:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712384 00000100:00100000:0.0:1787430687.751278:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712384 00000100:00100000:1.0:1787430687.751316:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787430687.751324:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:6494:x1874256847712384:12345-0@lo:101: 00010000:00010000:1.0:1787430687.751333:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430687.751345:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93c9e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.751364:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.751374:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.751381:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013eb400, rc 0) 00000100:00100000:1.0:1787430687.751423:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847712384:12345-0@lo:101: Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.751429:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430687.751502:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712384:0@lo:101: 00010000:00010000:3.0:1787430687.751522:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.751531:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430687.751572:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712512:0@lo:256: 00000100:00100000:3.0:1787430687.751638:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.751650:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.751720:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712512 00000100:00100000:1.0:1787430687.751725:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712512 00000100:00100000:1.0:1787430687.751744:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787430687.751749:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847712512:12345-0@lo:256: 20000000:01000000:1.0:1787430687.751762:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430687.751778:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430687.751781:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787430687.752039:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847712512:12345-0@lo:256: Request processed in 288us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.752046:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787430687.752132:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712512:0@lo:256: 10000000:01000000:3.0:1787430687.752181:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430687.752187:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.752195:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430687.752202:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787430687.752203:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787430687.752205:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787430687.752230:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.752238:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.752245:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430687.752265:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712640:0@lo:101: 00000100:00100000:3.0:1787430687.752288:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.752311:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.752411:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712640 00000100:00100000:1.0:1787430687.752415:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712640 00000100:00100000:1.0:1787430687.752435:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787430687.752441:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847712640:12345-0@lo:101: 00010000:00010000:1.0:1787430687.752449:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430687.752458:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93cac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.752472:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.752480:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430687.752487:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013ebc00, rc 0) 00000100:00100000:1.0:1787430687.752535:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847712640:12345-0@lo:101: Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.752546:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787430687.752821:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712640:0@lo:101: 00010000:00010000:3.0:1787430687.752832:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.752840:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430687.752889:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712768:0@lo:501: 00000100:00100000:3.0:1787430687.752913:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.752935:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.753013:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712768 00000100:00100000:1.0:1787430687.753017:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712768 00000100:00100000:1.0:1787430687.753036:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787430687.753043:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847712768:12345-0@lo:501: 00000100:00100000:1.0:1787430687.753146:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847712768:12345-0@lo:501: Request processed in 103us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.753153:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430687.753261:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712768:0@lo:501: 00000100:00100000:3.0:1787430687.753286:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712896:0@lo:503: 00000100:00100000:3.0:1787430687.753320:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.753328:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430687.753371:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847712896 00000100:00100000:1.0:1787430687.753375:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847712896 00000100:00100000:1.0:1787430687.753391:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787430687.753397:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847712896:12345-0@lo:503: 00000100:00100000:1.0:1787430687.753521:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847712896:12345-0@lo:503: Request processed in 124us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430687.753528:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787430687.753840:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847712896:0@lo:503: 00000100:00100000:1.0:1787430687.754142:0:8065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8065:1874256847713024:0@lo:502: 00000100:00100000:1.0:1787430687.754232:0:8065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430687.754279:0:8065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.754307:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713024 00000100:00100000:2.0:1787430687.754311:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713024 00000100:00100000:2.0:1787430687.754369:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787430687.754375:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8065:x1874256847713024:12345-0@lo:502: 00000100:00100000:2.0:1787430687.754445:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8065:x1874256847713024:12345-0@lo:502: Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430687.754449:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787430687.754520:0:8065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8065:1874256847713024:0@lo:502: 00000020:01000000:1.0:1787430687.754542:0:8065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430687.754553:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430687.754555:0:8065:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787430687.754559:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787430687.754564:0:8065:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:1.0:1787430687.754587:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787430687.754629:0:8065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e2c35de99b8) 00000020:00000080:1.0:1787430687.754651:0:8065:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787430687.754662:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787430687.754737:0:8065:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787430687.754743:0:8065:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787430687.754749:0:8065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93cc1 00010000:00080000:1.0:1787430687.754778:0:8065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c077e6000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1787430687.756386:0:8065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1787430687.757523:0:8065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787430687.757533:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787430687.757560:0:8065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787430687.757576:0:8065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a93cc8 00000100:00080000:3.0:1787430687.757583:0:8065:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430687.757587:0:8065:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2c077e6000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430687.757644:0:8065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c11578a80 x1874256847713152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430687.757668:0:8065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1787430687.757704:0:8065:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787430687.757794:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847713152:0@lo:38: 00000100:00100000:1.0:1787430687.757854:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.757940:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713152 00000100:00100000:3.0:1787430687.757947:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713152 00000100:00100000:3.0:1787430687.757985:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430687.757993:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1874256847713152:12345-0@lo:38: 00010000:00080000:3.0:1787430687.758018:0:6503:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:3.0:1787430687.758050:0:6503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a93ccf 00000004:00100000:3.0:1787430687.758068:0:6503:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787430687.758074:0:6503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787430687.758353:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847713408:0@lo:400: 00000100:00100000:0.0:1787430687.758384:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.758405:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430687.758410:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847713536:0@lo:400: 00000100:00100000:0.0:1787430687.758433:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.758460:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713536 00000100:00100000:0.0:1787430687.758464:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713536 00000100:00100000:0.0:1787430687.758509:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430687.758516:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847713536:12345-0@lo:400: 00000100:00100000:0.0:1787430687.758562:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847713536:12345-0@lo:400: Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.758569:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430687.758592:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787430687.758623:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:0.0:1787430687.758653:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2c3a4df100 x1874256847713536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430687.758664:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847713536:0@lo:400: 00000100:00100000:0.0:1787430687.758818:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713408 00000100:00100000:0.0:1787430687.758822:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713408 00000100:00100000:0.0:1787430687.758904:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430687.758912:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847713408:12345-0@lo:400: 00000100:00100000:0.0:1787430687.758950:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847713408:12345-0@lo:400: Request processed in 39us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.758956:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430687.758980:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847713408:0@lo:400: 00000100:00100000:3.0:1787430687.759189:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430687.759199:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847713280:0@lo:400: 00000100:00100000:3.0:1787430687.759232:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.759261:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713280 00000100:00100000:3.0:1787430687.759265:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713280 00000100:00100000:3.0:1787430687.759290:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430687.759297:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847713280:12345-0@lo:400: 00000100:00100000:3.0:1787430687.759330:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847713280:12345-0@lo:400: Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.759336:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787430687.759363:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2c3a4de300 x1874256847713280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430687.759373:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847713280:0@lo:400: 00000100:00080000:1.0:1787430687.760719:0:8068:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8e2c315ac700 x1874256847713664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430687.760731:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e65cc0 going to sleep for 0 seconds 00000020:01000000:3.0:1787430687.760776:0:8065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430687.760782:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430687.760791:0:8065:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787430687.760795:0:8065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430687.760800:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430687.760802:0:8065:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430687.760805:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430687.760807:0:8065:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787430687.761068:0:8065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c1157a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8065:1874256847713792:0@lo:502: 00000100:00100000:3.0:1787430687.761132:0:8065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.761172:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713792 00000100:00100000:3.0:1787430687.761173:0:8065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430687.761180:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713792 00000100:00100000:0.0:1787430687.761228:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787430687.761237:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8065:x1874256847713792:12345-0@lo:502: 00000100:00100000:0.0:1787430687.761359:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8065:x1874256847713792:12345-0@lo:502: Request processed in 123us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.761367:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787430687.761559:0:8065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c1157a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8065:1874256847713792:0@lo:502: 00000020:01000000:3.0:1787430687.761584:0:8065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430687.761589:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430687.761591:0:8065:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787430687.761595:0:8065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787430687.761806:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787430687.761891:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787430687.761903:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.761914:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430687.761924:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787430687.761927:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c04f2d000 from 1 10000000:01000000:2.0:1787430687.761929:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430687.761954:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.761962:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.761983:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430687.761999:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847713920:0@lo:101: 00000100:00100000:2.0:1787430687.762030:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.762096:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430687.762141:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713920 00000100:00100000:3.0:1787430687.762146:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713920 00000100:00100000:3.0:1787430687.762230:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787430687.762239:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847713920:12345-0@lo:101: 00010000:00010000:3.0:1787430687.762248:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430687.762258:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93cd6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.762279:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.762290:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.762299:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a200, rc 0) 00000100:00100000:3.0:1787430687.762332:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847713920:12345-0@lo:101: Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.762346:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787430687.762516:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847713920:0@lo:101: 00010000:00010000:2.0:1787430687.762531:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.762543:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430687.762713:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847714048:0@lo:501: 00000100:00100000:2.0:1787430687.762742:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.763649:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430687.764464:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714048 00000100:00100000:0.0:1787430687.764473:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714048 00000100:00100000:0.0:1787430687.764530:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787430687.764540:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847714048:12345-0@lo:501: 00000100:00100000:0.0:1787430687.764725:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847714048:12345-0@lo:501: Request processed in 186us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.764733:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787430687.765399:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847714048:0@lo:501: 00000100:00100000:2.0:1787430687.765448:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847714176:0@lo:503: 00000100:00100000:2.0:1787430687.765511:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.765541:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.765554:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714176 00000100:00100000:2.0:1787430687.765557:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714176 00000100:00100000:2.0:1787430687.765588:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787430687.765595:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847714176:12345-0@lo:503: 00000100:00100000:2.0:1787430687.765700:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847714176:12345-0@lo:503: Request processed in 104us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430687.765714:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787430687.765873:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847714176:0@lo:503: 00000100:00080000:0.0:1787430687.768384:0:6503:0:(import.c:65:import_set_state_nolock()) ffff8e2c35cb4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430687.768533:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1874256847713152:12345-0@lo:38: Request processed in 10537us (10675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.768544:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787430687.768952:0:8070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8070:1874256847714304:0@lo:502: 00000100:00100000:2.0:1787430687.769008:0:8070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.769039:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714304 00000100:00100000:2.0:1787430687.769047:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714304 00000100:00100000:2.0:1787430687.769086:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787430687.769096:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8070:x1874256847714304:12345-0@lo:502: 00000100:00100000:2.0:1787430687.769193:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8070:x1874256847714304:12345-0@lo:502: Request processed in 99us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430687.769201:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787430687.769249:0:8070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.769272:0:8070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8070:1874256847714304:0@lo:502: 00000020:01000000:2.0:1787430687.769301:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430687.769309:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430687.769312:0:8070:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787430687.769323:0:8070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c04f2d000 00000020:00000080:2.0:1787430687.769326:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430687.769347:0:8070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8070:1874256847714432:0@lo:502: 00000100:00100000:2.0:1787430687.769382:0:8070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.769399:0:8070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.769772:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714432 00000100:00100000:2.0:1787430687.769777:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714432 00000100:00100000:2.0:1787430687.769855:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787430687.769864:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8070:x1874256847714432:12345-0@lo:502: 00000100:00100000:2.0:1787430687.769951:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8070:x1874256847714432:12345-0@lo:502: Request processed in 88us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430687.769964:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430687.770137:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430687.770146:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787430687.770154:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787430687.770160:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787430687.770164:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c077e6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787430687.770179:0:3626:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cbd4c274): req@ffff8e2c315ac700 x1874256847713664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430687.770195:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847713152:0@lo:38: 00000100:00100000:3.0:1787430687.770274:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.770298:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e65cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430687.770309:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847714560:0@lo:41: 00000100:00100000:3.0:1787430687.770327:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.770381:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847713664 00000100:00100000:0.0:1787430687.770386:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847713664 00000100:00100000:0.0:1787430687.770421:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714560 00000100:00100000:0.0:1787430687.770425:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714560 00000100:00100000:0.0:1787430687.770440:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430687.770447:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8068:x1874256847713664:12345-0@lo:1000: 00000100:00100000:0.0:1787430687.770518:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8068:x1874256847713664:12345-0@lo:1000: Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.770525:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430687.770544:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430687.770550:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847714560:12345-0@lo:41: 00000004:00000024:0.0:1787430687.770572:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787430687.770641:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847714560:12345-0@lo:41: Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.770648:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430687.770677:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847713664:0@lo:1000: 00000040:01000000:0.0:1787430687.770704:0:8068:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787430687.770733:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847714688:0@lo:1000: 00000100:00100000:0.0:1787430687.770772:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.770785:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aeb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430687.770803:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847714560:0@lo:41: 00000100:00100000:0.0:1787430687.770816:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714688 00000100:00100000:0.0:1787430687.770818:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714688 00000100:00100000:0.0:1787430687.771014:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430687.771022:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8068:x1874256847714688:12345-0@lo:1000: 00000100:00100000:0.0:1787430687.771092:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8068:x1874256847714688:12345-0@lo:1000: Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.771097:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430687.771264:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847714688:0@lo:1000: 00000100:00100000:0.0:1787430687.771295:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847714816:0@lo:700: 00000100:00100000:0.0:1787430687.771313:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.771324:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430687.771332:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714816 00000100:00100000:0.0:1787430687.771334:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714816 00000100:00100000:0.0:1787430687.771365:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430687.771380:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:8068:x1874256847714816:12345-0@lo:700: 00000100:00100000:0.0:1787430687.771418:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:8068:x1874256847714816:12345-0@lo:700: Request processed in 41us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430687.771423:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430687.771445:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847714816:0@lo:700: 00000100:00100000:0.0:1787430687.771544:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847714944:0@lo:1000: 00000100:00100000:0.0:1787430687.771567:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430687.771571:0:8070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8070:1874256847714432:0@lo:502: 00000100:00100000:0.0:1787430687.771580:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aeb540 going to sleep for 11 seconds 00000020:01000000:2.0:1787430687.771596:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430687.771618:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430687.771620:0:8070:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787430687.771629:0:8070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787430687.771681:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 00000100:00100000:0.0:1787430687.771682:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847714944 00000100:00100000:0.0:1787430687.771686:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847714944 10000000:01000000:2.0:1787430687.771699:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00000100:00100000:0.0:1787430687.771703:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787430687.771708:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430687.771709:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8068:x1874256847714944:12345-0@lo:1000: 00010000:00010000:2.0:1787430687.771719:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430687.771728:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787430687.771730:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e2c10964d28 from 1 10000000:01000000:2.0:1787430687.771733:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1787430687.771753:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8068:x1874256847714944:12345-0@lo:1000: Request processed in 44us (184us total) trans 0 rc 0/0 00010000:00010000:2.0:1787430687.771757:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430687.771760:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787430687.771764:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.771773:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430687.771782:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847714944:0@lo:1000: 00000100:00100000:2.0:1787430687.771784:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847715072:0@lo:101: 00000100:00100000:2.0:1787430687.771813:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787430687.771819:0:8068:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e2c18aeba80 with version 0 00000100:00100000:2.0:1787430687.771839:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.771859:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847715072 00000100:00100000:2.0:1787430687.771863:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847715072 00000100:00100000:2.0:1787430687.771893:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787430687.771901:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847715072:12345-0@lo:101: 00010000:00010000:2.0:1787430687.771909:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430687.771931:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ce4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.771953:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.771964:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.771974:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174800, rc 0) 00000020:00100000:0.0:1787430687.772012:0:8068:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787430687.772013:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847715072:12345-0@lo:101: Request processed in 113us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430687.772019:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787430687.772019:0:8068:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e2c3a4ddf80 x1874256847715328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430687.772031:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847715328:0@lo:1000: 00000100:00100000:0.0:1787430687.772053:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430687.772067:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430687.772077:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847715328 00000100:00100000:0.0:1787430687.772080:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847715328 00000100:00100000:3.0:1787430687.772137:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847715072:0@lo:101: 00010000:00010000:3.0:1787430687.772150:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430687.772163:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430687.772215:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847715456:0@lo:501: 00000100:00100000:3.0:1787430687.772240:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.772252:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430687.772286:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430687.772310:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8068:x1874256847715328:12345-0@lo:1000: 00000100:00100000:2.0:1787430687.772314:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847715456 00000100:00100000:2.0:1787430687.772317:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847715456 00000100:00100000:2.0:1787430687.772354:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787430687.772361:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847715456:12345-0@lo:501: 00000100:00100000:2.0:1787430687.772427:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847715456:12345-0@lo:501: Request processed in 66us (186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787430687.772434:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787430687.772456:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847715456:0@lo:501: 10000000:01000000:2.0:1787430687.772477:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787430687.772483:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430687.772507:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430687.788854:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1787430687.788869:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787430687.789095:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8068:x1874256847715328:12345-0@lo:1000: Request processed in 16781us (17036us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787430687.789109:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787430687.789334:0:8068:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787430687.789339:0:8068:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787430687.789353:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847715328:0@lo:1000: 00000100:00100000:1.0:1787430687.789451:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847715584:0@lo:1000: 00000100:00100000:1.0:1787430687.789513:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.789618:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847715584 00000100:00100000:3.0:1787430687.789630:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847715584 00000100:00100000:1.0:1787430687.789687:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c13061b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430687.796036:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787430687.796055:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8068:x1874256847715584:12345-0@lo:1000: 00000100:00100000:3.0:1787430687.796186:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8068:x1874256847715584:12345-0@lo:1000: Request processed in 139us (6672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430687.796194:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430687.796287:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8068:1874256847715584:0@lo:1000: 00000040:00080000:1.0:1787430687.796315:0:8068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787430687.796353:0:8068:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8e2c35c8d9c0 with version 1 00000040:00080000:1.0:1787430687.798428:0:8068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787430687.798523:0:8068:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787430687.798528:0:8068:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1787430687.798911:0:8066:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8e2c04e65b40 version 1 rpc_version 1 00000020:00100000:3.0:1787430687.798948:0:8066:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787430687.798958:0:8066:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8e2c11578000 x1874256847715840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787430687.798980:0:8066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8066:1874256847715840:0@lo:1000: 00000100:00100000:3.0:1787430687.799045:0:8066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430687.799100:0:8066:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430687.799187:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847715840 00000100:00100000:2.0:1787430687.799195:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847715840 00000100:00100000:2.0:1787430687.799246:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430687.799256:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8066:x1874256847715840:12345-0@lo:1000: 00000001:00080000:3.0:1787430687.806215:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787430687.813049:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8066:x1874256847715840:12345-0@lo:1000: Request processed in 13785us (13995us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787430687.813063:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1787430687.813080:0:8066:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787430687.813085:0:8066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787430687.813102:0:8066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8066:1874256847715840:0@lo:1000: 00010000:00010000:3.0:1787430688.768034:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430689.792548:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430690.561725:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430690.561754:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847715968:0@lo:41: 00000100:00100000:3.0:1787430690.561829:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430690.562775:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847715968 00000100:00100000:1.0:1787430690.562784:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847715968 00000100:00100000:1.0:1787430690.562850:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787430690.562862:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847715968:12345-0@lo:41: 00000004:00000024:1.0:1787430690.562896:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787430690.562961:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847715968:12345-0@lo:41: Request processed in 101us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430690.562969:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430690.563102:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847715968:0@lo:41: 00010000:00010000:3.0:1787430690.816734:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787430691.036755:0:8402:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787430691.036760:0:8402:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787430691.036761:0:8402:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787430691.036896:0:8402:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2c35f42000 00000020:01000004:0.0:1787430691.036917:0:8402:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787430691.036930:0:8402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787430691.036943:0:8402:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e2c3a798000) 00000020:00000080:0.0:1787430691.036959:0:8402:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787430691.070744:0:8402:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787430691.070796:0:8402:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1787430691.087873:0:8402:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787430691.088169:0:8402:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787430691.088181:0:8402:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787430691.088193:0:8402:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4dbb683ba6a93cf9 00000020:01000004:1.0:1787430691.088199:0:8402:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787430691.088221:0:8402:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787430691.088224:0:8402:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787430691.088230:0:8402:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787430691.088235:0:8402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787430691.088248:0:8402:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e2c35de8000) 00000020:00000080:1.0:1787430691.088260:0:8402:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1787430691.089768:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430691.089982:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787430691.089988:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787430691.090509:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787430691.090516:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787430691.091770:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787430691.091779:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787430691.095127:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430691.096692:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787430691.096699:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787430691.097310:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787430691.097316:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787430691.118149:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430691.118666:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787430691.118688:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787430691.121033:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787430691.121045:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787430691.123326:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787430691.123351:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787430691.127477:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430691.127854:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787430691.127860:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787430691.128725:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787430691.128733:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787430691.163026:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430691.163241:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787430691.163247:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787430691.165190:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787430691.165202:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787430691.165598:0:8402:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787430691.165643:0:8402:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787430691.165648:0:8402:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787430691.182344:0:8402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787430691.182377:0:8402:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787430691.182381:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787430691.182383:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787430691.182384:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430691.182389:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430691.182390:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430691.182392:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430691.182393:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430691.182394:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430691.182396:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430691.182397:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430691.182398:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787430691.182402:0:8402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787430691.182404:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430691.182405:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787430691.182406:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430691.182407:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430691.182408:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430691.182409:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430691.182409:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430691.182410:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430691.182411:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430691.182412:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430691.182413:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787430691.182445:0:8402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787430691.182474:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847716096:0@lo:253: 00000100:00100000:0.0:1787430691.182548:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430691.182735:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430691.182950:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716096 00000100:00100000:3.0:1787430691.182958:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716096 00000100:00100000:2.0:1787430691.183115:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787430691.183125:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:8402:x1874256847716096:12345-0@lo:253: 20000000:01000000:2.0:1787430691.183155:0:6491:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787430691.183159:0:6491:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787430691.183163:0:6491:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787430691.183166:0:6491:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787430691.183358:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430691.183501:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787430691.183515:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787430691.183531:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787430691.183536:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787430691.183547:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787430691.183560:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787430691.183675:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787430691.183690:0:6491:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:2.0:1787430691.183692:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1787430691.183707:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787430691.183714:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787430691.183748:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787430691.183756:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1787430691.183771:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787430691.183778:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787430691.183790:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787430691.183804:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787430691.183873:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787430691.183995:0:6491:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:2.0:1787430691.183998:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1787430691.184016:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787430691.184023:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787430691.184035:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787430691.184039:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1787430691.184051:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787430691.184056:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787430691.184067:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787430691.184080:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787430691.184441:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787430691.184453:0:6491:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:2.0:1787430691.184455:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1787430691.184483:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787430691.184490:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787430691.184503:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787430691.184509:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1787430691.184523:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787430691.184529:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787430691.184542:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787430691.184557:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787430691.184569:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787430691.184572:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787430691.184581:0:6491:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787430691.185256:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787430691.185260:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787430691.188961:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1787430691.189021:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1787430691.189040:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787430691.189301:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787430691.189327:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787430691.189342:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787430691.189354:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787430691.189357:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787430691.189851:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1787430691.189873:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1787430691.189966:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787430691.190134:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1787430691.190154:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1787430691.190169:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1787430691.190179:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787430691.190181:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787430691.190473:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787430691.190769:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787430691.190793:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787430691.190808:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787430691.190827:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787430691.190829:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787430691.191246:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1787430691.191268:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1787430691.191284:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1787430691.191433:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1787430691.191454:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1787430691.191494:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:0.0:1787430691.191512:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787430691.191532:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191551:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c01491200/0x4dbb683ba6a93bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191558:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191565:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191572:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191579:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191586:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191761:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.191778:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 18 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.191805:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716224:0@lo:104: 00000100:00100000:0.0:1787430691.191875:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430691.192037:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.192047:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 18 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.192056:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4df480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716352:0@lo:104: 00000100:00100000:0.0:1787430691.192079:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430691.192156:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.192164:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 18 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.192174:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716480:0@lo:104: 00000100:00100000:0.0:1787430691.192194:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430691.192238:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716224 00000100:00100000:1.0:1787430691.192246:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716224 00000100:00100000:1.0:1787430691.192280:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716352 00000100:00100000:1.0:1787430691.192283:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716352 00000100:00100000:1.0:1787430691.192316:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430691.192325:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6491:x1874256847716224:12345-0@lo:104: 00010000:00010000:1.0:1787430691.192338:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.192393:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430691.192400:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6491:x1874256847716224:12345-0@lo:104: Request processed in 76us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430691.192407:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430691.192425:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430691.192431:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6491:x1874256847716352:12345-0@lo:104: 00010000:00010000:1.0:1787430691.192439:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.192481:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430691.192485:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6491:x1874256847716352:12345-0@lo:104: Request processed in 56us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430691.192491:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787430691.192544:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430691.192551:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192558:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175c00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430691.192561:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192568:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430691.192575:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430691.192580:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430691.192631:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192638:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430691.192656:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192674:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ceb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192687:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430691.192690:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192695:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ae00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430691.192698:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192705:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430691.192712:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430691.192717:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430691.192732:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192738:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430691.192744:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192750:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93cb3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.192758:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430691.192765:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430691.192767:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430691.192773:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430691.192786:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847716736:0@lo:103: 00000100:00100000:3.0:1787430691.192815:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430691.192844:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430691.192851:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847716608:0@lo:103: 00000100:00100000:3.0:1787430691.192872:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430691.192913:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716736 00000100:00100000:3.0:1787430691.192917:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716736 00010000:00010000:3.0:1787430691.192935:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 19 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430691.192955:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716608 00000100:00100000:3.0:1787430691.192957:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716608 00010000:00010000:3.0:1787430691.192968:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 20 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430691.192979:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430691.192985:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3628:x1874256847716736:12345-0@lo:103: 00010000:00010000:3.0:1787430691.192994:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430691.192999:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 20 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.193007:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 20 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.193022:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430691.193047:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3628:x1874256847716736:12345-0@lo:103: Request processed in 63us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.193062:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430691.193076:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430691.193081:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3628:x1874256847716608:12345-0@lo:103: 00010000:00010000:3.0:1787430691.193087:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430691.193091:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 19 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.193100:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 19 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.193109:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430691.193130:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3628:x1874256847716608:12345-0@lo:103: Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.193136:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430691.193171:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847716608:0@lo:103: 00000100:00100000:3.0:1787430691.193179:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847716736:0@lo:103: 00010000:00010000:0.0:1787430691.193322:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.193332:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93c4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 18 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.193340:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716864:0@lo:104: 00000100:00100000:0.0:1787430691.193362:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430691.193379:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c01491200/0x4dbb683ba6a93bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.193399:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c01491200/0x4dbb683ba6a93bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 18 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.193408:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716992:0@lo:104: 00000100:00100000:0.0:1787430691.193431:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430691.193441:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c225cacc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787430691.193452:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93ceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93ce4 expref: 18 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.193473:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4ddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716224:0@lo:104: 00010000:00010000:0.0:1787430691.193483:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93cac expref: 17 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.193493:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4df480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716352:0@lo:104: 00000100:00100000:3.0:1787430691.193593:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716480 00000100:00100000:3.0:1787430691.193598:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716480 00000100:00100000:3.0:1787430691.193653:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716864 00000100:00100000:3.0:1787430691.193656:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716864 00000100:00100000:3.0:1787430691.193665:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847716992 00000100:00100000:3.0:1787430691.193667:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847716992 00000100:00100000:3.0:1787430691.193679:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430691.193685:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6491:x1874256847716480:12345-0@lo:104: 00010000:00010000:3.0:1787430691.193693:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.193745:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430691.193751:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6491:x1874256847716480:12345-0@lo:104: Request processed in 67us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.193757:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430691.193772:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430691.193778:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6491:x1874256847716864:12345-0@lo:104: 00010000:00010000:3.0:1787430691.193785:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.193816:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787430691.193821:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6491:x1874256847716864:12345-0@lo:104: Request processed in 45us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.193827:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430691.193838:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430691.193844:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6491:x1874256847716992:12345-0@lo:104: 00010000:00010000:3.0:1787430691.193850:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.193871:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787430691.193875:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6491:x1874256847716992:12345-0@lo:104: Request processed in 32us (445us total) trans 0 rc 0/0 00010000:00010000:1.0:1787430691.193966:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787430691.193971:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.193977:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430691.193981:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.193989:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430691.194006:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430691.194012:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430691.194029:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194035:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430691.194053:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194059:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a93c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194071:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430691.194074:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194080:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c013ea000 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430691.194082:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194089:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430691.194095:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430691.194100:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430691.194121:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194126:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430691.194131:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194137:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c013ea000/0x4dbb683ba6a93c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c4a expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194147:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430691.194150:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194156:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430691.194158:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194165:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430691.194171:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430691.194177:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430691.194199:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194205:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430691.194218:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194234:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93bd3 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.194249:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430691.194250:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430691.194252:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430691.194263:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847717376:0@lo:103: 00000100:00100000:1.0:1787430691.194291:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430691.194349:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430691.194370:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847717120:0@lo:103: 00000100:00100000:3.0:1787430691.194393:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430691.194418:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430691.194424:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847717248:0@lo:103: 00000100:00100000:3.0:1787430691.194453:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430691.194486:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847717376 00000100:00100000:3.0:1787430691.194490:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847717376 00010000:00010000:3.0:1787430691.194507:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c01491200/0x4dbb683ba6a93bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 17 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430691.194521:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847717120 00000100:00100000:3.0:1787430691.194523:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847717120 00010000:00010000:3.0:1787430691.194533:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 18 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430691.194544:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847717248 00000100:00100000:3.0:1787430691.194546:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847717248 00010000:00010000:3.0:1787430691.194555:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93c4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 19 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430691.194567:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430691.194573:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3627:x1874256847717376:12345-0@lo:103: 00010000:00010000:3.0:1787430691.194581:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430691.194586:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c01491200/0x4dbb683ba6a93bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 19 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194595:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c01491200/0x4dbb683ba6a93bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 19 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194634:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430691.194662:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3627:x1874256847717376:12345-0@lo:103: Request processed in 89us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.194668:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430691.194681:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430691.194687:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:3629:x1874256847717120:12345-0@lo:103: 00010000:00010000:3.0:1787430691.194701:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430691.194706:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 18 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194715:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 18 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194725:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430691.194750:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:3629:x1874256847717120:12345-0@lo:103: Request processed in 63us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.194756:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430691.194768:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430691.194775:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11443450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:3629:x1874256847717248:12345-0@lo:103: 00010000:00010000:3.0:1787430691.194782:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430691.194787:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93c4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 17 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194795:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93c4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 17 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194806:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194813:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194827:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194835:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194848:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194855:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194860:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430691.194864:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.194872:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.195001:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93c90 expref: 17 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.195014:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716480:0@lo:104: 00010000:00010000:0.0:1787430691.195025:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93c43 expref: 16 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.195033:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716864:0@lo:104: 00010000:00010000:0.0:1787430691.195042:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c01491200/0x4dbb683ba6a93bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93bcc expref: 15 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.195050:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6491:1874256847716992:0@lo:104: 00010000:00010000:0.0:1787430691.195074:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.195089:0:6491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.195096:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430691.195105:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787430691.195755:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847717120:0@lo:103: 00010000:00010000:0.0:1787430691.195773:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430691.195786:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847717376:0@lo:103: 00010000:00010000:3.0:1787430691.195855:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.195865:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93d07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.195878:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430691.196076:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11443450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:3629:x1874256847717248:12345-0@lo:103: Request processed in 1301us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.196084:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430691.196191:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847717248:0@lo:103: 00000100:00100000:0.0:1787430691.197483:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:8402:x1874256847716096:12345-0@lo:253: Request processed in 14356us (14931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.197493:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787430691.197644:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847716096:0@lo:253: 10000000:01000000:2.0:1787430691.197656:0:8402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787430691.197659:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430691.197661:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430691.197662:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430691.197663:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787430691.197664:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430691.197666:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430691.197667:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430691.197669:0:8402:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787430691.197670:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430691.197672:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787430691.197687:0:8402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2c35f42000 from lustre-OST0000 10000000:01000000:2.0:1787430691.197714:0:8402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787430691.197717:0:8402:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787430691.197725:0:8402:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e2c10964d28 local copy 10000000:01000000:2.0:1787430691.197728:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787430691.197761:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.197772:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.197780:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.197797:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847717504:0@lo:101: 00000100:00100000:2.0:1787430691.197831:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.197877:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430691.198054:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847717504 00000100:00100000:0.0:1787430691.198060:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847717504 00000100:00100000:0.0:1787430691.198106:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787430691.198115:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+13:8402:x1874256847717504:12345-0@lo:101: 00010000:00010000:0.0:1787430691.198130:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430691.198143:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c00031800/0x4dbb683ba6a93d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93d0e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.198167:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c00031800/0x4dbb683ba6a93d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d0e expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.198178:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c00031800/0x4dbb683ba6a93d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d0e expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.198193:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031800, rc 0) 00000100:00100000:0.0:1787430691.198232:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847717504:12345-0@lo:101: Request processed in 118us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.198238:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787430691.198566:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847717504:0@lo:101: 00010000:00010000:2.0:1787430691.198579:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.198588:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.198702:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847717632:0@lo:501: 00000100:00100000:2.0:1787430691.198729:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.198740:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430691.198844:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847717632 00000100:00100000:0.0:1787430691.198850:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847717632 00000100:00100000:0.0:1787430691.198883:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787430691.198890:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847717632:12345-0@lo:501: 00000100:00100000:0.0:1787430691.198953:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847717632:12345-0@lo:501: Request processed in 63us (223us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430691.198960:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787430691.198980:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847717632:0@lo:501: 10000000:01000000:2.0:1787430691.198991:0:8402:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787430691.199008:0:8402:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787430691.199013:0:8402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.199021:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.199028:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.199048:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787430691.199070:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2c35f42000 10000000:01000000:2.0:1787430691.199074:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787430691.199078:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787430691.199081:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430691.199085:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787430691.199094:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787430691.199108:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.199115:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.199123:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.199133:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847717760:0@lo:101: 00000100:00100000:2.0:1787430691.199157:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.199182:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787430691.199291:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430691.199300:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.199310:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430691.199314:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.199322:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430691.199329:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430691.199337:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430691.199355:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.199360:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430691.199389:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.199406:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93d15 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.199419:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430691.199420:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430691.199422:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430691.199476:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847717760 00000100:00100000:0.0:1787430691.199480:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847717760 00000100:00100000:0.0:1787430691.199502:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430691.199509:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847717760:12345-0@lo:101: 00000100:00100000:2.0:1787430691.199513:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787430691.199515:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787430691.199523:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847717888:0@lo:103: 00010000:00010000:0.0:1787430691.199524:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93d1c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.199537:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.199546:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.199548:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430691.199553:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030600, rc 0) 00000100:00100000:0.0:1787430691.199580:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847717760:12345-0@lo:101: Request processed in 72us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.199586:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847717760:0@lo:101: 00000100:00100000:0.0:1787430691.199592:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1787430691.199596:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.199621:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.199669:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718016:0@lo:501: 00000100:00100000:1.0:1787430691.199688:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847717888 00000100:00100000:2.0:1787430691.199692:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430691.199692:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847717888 00000100:00100000:2.0:1787430691.199712:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718016 00000100:00100000:2.0:1787430691.199715:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718016 00000100:00100000:1.0:1787430691.199718:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430691.199724:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:3627:x1874256847717888:12345-0@lo:103: 00010000:00010000:1.0:1787430691.199733:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787430691.199734:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787430691.199740:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847718016:12345-0@lo:501: 00010000:00010000:1.0:1787430691.199744:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c00031800/0x4dbb683ba6a93d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93d0e expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.199753:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430691.199783:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:3627:x1874256847717888:12345-0@lo:103: Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430691.199789:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430691.199818:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718016:12345-0@lo:501: Request processed in 77us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.199824:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787430691.199851:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847717888:0@lo:103: 00000100:00100000:2.0:1787430691.199873:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430691.199895:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718016:0@lo:501: 00000100:00100000:2.0:1787430691.199919:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718144:0@lo:503: 00000100:00100000:2.0:1787430691.199954:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.199970:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430691.199992:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718144 00000100:00100000:0.0:1787430691.199996:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718144 00000100:00100000:0.0:1787430691.200025:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787430691.200031:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718144:12345-0@lo:503: 00000100:00100000:0.0:1787430691.200109:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718144:12345-0@lo:503: Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.200116:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787430691.200126:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718144:0@lo:503: 00000040:00080000:2.0:1787430691.200359:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430691.200551:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718272:0@lo:502: 00000100:00100000:2.0:1787430691.200578:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.200594:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430691.201019:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718272 00000100:00100000:0.0:1787430691.201025:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718272 00000100:00100000:0.0:1787430691.201098:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787430691.201106:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718272:12345-0@lo:502: 00000100:00100000:0.0:1787430691.201340:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718272:12345-0@lo:502: Request processed in 234us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.201346:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787430691.201410:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718272:0@lo:502: 00000040:00080000:3.0:1787430691.201792:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787430691.201820:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787430691.201833:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787430691.201845:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787430691.201856:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787430691.201878:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787430691.201901:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718400:0@lo:502: 00000100:00100000:3.0:1787430691.201939:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430691.202007:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430691.202039:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718400 00000100:00100000:0.0:1787430691.202044:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718400 00000100:00100000:0.0:1787430691.202070:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787430691.202078:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718400:12345-0@lo:502: 00000100:00100000:0.0:1787430691.202191:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718400:12345-0@lo:502: Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.202198:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787430691.202253:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718400:0@lo:502: 00000040:00080000:3.0:1787430691.202289:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787430691.202296:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787430691.203400:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787430691.203408:0:8425:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787430691.203414:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430691.203417:0:8425:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787430691.203435:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430691.203456:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e2c3a79cd28) 00000020:00000080:0.0:1787430691.203486:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787430691.203495:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787430691.203565:0:8425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c35f42000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787430691.203574:0:8425:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787430691.203581:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4dbb683ba6a93d31 00010000:00010000:0.0:1787430691.208827:0:8425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787430691.209102:0:8425:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787430691.212195:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787430691.212544:0:8425:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787430691.218327:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787430691.218537:0:8425:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787430691.223996:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787430691.226451:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787430691.226492:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430691.226499:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430691.226501:0:8425:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787430691.226506:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430691.226510:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430691.226512:0:8425:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430691.226515:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430691.226517:0:8425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787430691.226538:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430691.226540:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430691.226541:0:8425:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787430691.226545:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787430691.227045:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787430691.227077:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787430691.227102:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.227115:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430691.227123:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c35f42000 from 1 10000000:01000000:2.0:1787430691.227126:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430691.227158:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.227177:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.227188:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.227211:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718528:0@lo:101: 00000100:00100000:2.0:1787430691.227278:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.227330:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430691.227520:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718528 00000100:00100000:1.0:1787430691.227530:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718528 00000100:00100000:1.0:1787430691.227578:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787430691.227587:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:8402:x1874256847718528:12345-0@lo:101: 00010000:00010000:1.0:1787430691.227619:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430691.227631:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93d38 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.227653:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.227672:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430691.227682:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013ea000, rc 0) 00000100:00100000:1.0:1787430691.227731:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847718528:12345-0@lo:101: Request processed in 146us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430691.227738:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787430691.227817:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718528:0@lo:101: 00010000:00010000:2.0:1787430691.227831:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.227840:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.227928:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718656:0@lo:501: 00000100:00100000:2.0:1787430691.227952:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.227979:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430691.228496:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718656 00000100:00100000:1.0:1787430691.228501:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718656 00000100:00100000:1.0:1787430691.228528:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787430691.228535:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847718656:12345-0@lo:501: 00000100:00100000:1.0:1787430691.228646:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847718656:12345-0@lo:501: Request processed in 111us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430691.228653:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787430691.228679:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718656:0@lo:501: 00000100:00100000:2.0:1787430691.228706:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718784:0@lo:503: 00000100:00100000:2.0:1787430691.228743:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.228770:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430691.228772:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718784 00000100:00100000:3.0:1787430691.228776:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718784 00000100:00100000:3.0:1787430691.228802:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787430691.228809:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847718784:12345-0@lo:503: 00000100:00100000:3.0:1787430691.228883:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847718784:12345-0@lo:503: Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.228890:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787430691.229006:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718784:0@lo:503: 00000040:00080000:2.0:1787430691.229208:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430691.229276:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718912:0@lo:502: 00000100:00100000:2.0:1787430691.229307:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.229580:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430691.230566:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847718912 00000100:00100000:0.0:1787430691.230574:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847718912 00000100:00100000:0.0:1787430691.232137:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787430691.232152:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847718912:12345-0@lo:502: 00000100:00100000:0.0:1787430691.232297:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847718912:12345-0@lo:502: Request processed in 149us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.232305:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787430691.232438:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847718912:0@lo:502: 00000040:00080000:2.0:1787430691.232718:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787430691.232748:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787430691.232781:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719040:0@lo:502: 00000100:00100000:2.0:1787430691.232825:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.233138:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430691.233308:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719040 00000100:00100000:3.0:1787430691.233315:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719040 00000100:00100000:2.0:1787430691.233410:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787430691.233418:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847719040:12345-0@lo:502: 00000100:00100000:2.0:1787430691.233542:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847719040:12345-0@lo:502: Request processed in 124us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.233550:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787430691.233682:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719040:0@lo:502: 00000040:00080000:3.0:1787430691.233739:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787430691.233747:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787430691.234180:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430691.234189:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430691.234191:0:8429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787430691.234198:0:8429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c35f42000 00000020:00000080:3.0:1787430691.234201:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430691.234214:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430691.234218:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430691.234219:0:8429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787430691.234222:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787430691.234341:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787430691.234362:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430691.234385:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.234396:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430691.234453:0:8402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787430691.234456:0:8402:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2c35f42000 10000000:01000000:2.0:1787430691.234459:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2c35f42000 10000000:01000000:2.0:1787430691.234472:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430691.234478:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c35f42000 from 1 10000000:01000000:2.0:1787430691.234481:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787430691.234512:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.234520:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.234530:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.234546:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719168:0@lo:101: 00000100:00100000:2.0:1787430691.234581:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.234639:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719168 00000100:00100000:2.0:1787430691.234644:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719168 00000100:00100000:2.0:1787430691.234668:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787430691.234674:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8402:x1874256847719168:12345-0@lo:101: 00010000:00010000:2.0:1787430691.234683:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430691.234693:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93d46 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.234712:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.234723:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.234731:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175600, rc 0) 00000100:00100000:2.0:1787430691.234757:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719168:12345-0@lo:101: Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.234763:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787430691.234795:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a797cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430691.234816:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719168:0@lo:101: 00010000:00010000:2.0:1787430691.234829:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.234838:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.234901:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719296:0@lo:501: 00000100:00100000:2.0:1787430691.234925:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.234945:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719296 00000100:00100000:2.0:1787430691.234949:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719296 00000100:00100000:2.0:1787430691.234967:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787430691.234972:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719296:12345-0@lo:501: 00000100:00100000:2.0:1787430691.235045:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719296:12345-0@lo:501: Request processed in 72us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.235052:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787430691.235074:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a797cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430691.235086:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719296:0@lo:501: 00000100:00100000:2.0:1787430691.235122:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719424:0@lo:503: 00000100:00100000:2.0:1787430691.235159:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.235180:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719424 00000100:00100000:2.0:1787430691.235184:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719424 00000100:00100000:2.0:1787430691.235201:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787430691.235207:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719424:12345-0@lo:503: 00000100:00100000:2.0:1787430691.235277:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719424:12345-0@lo:503: Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.235284:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787430691.235320:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10e61300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430691.235333:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719424:0@lo:503: 00000040:00080000:2.0:1787430691.235539:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430691.235597:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719552:0@lo:502: 00000100:00100000:2.0:1787430691.235653:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.235674:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719552 00000100:00100000:2.0:1787430691.235677:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719552 00000100:00100000:2.0:1787430691.235693:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787430691.235698:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719552:12345-0@lo:502: 00000100:00100000:2.0:1787430691.235758:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719552:12345-0@lo:502: Request processed in 59us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.235765:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787430691.235792:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10e61300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430691.235805:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719552:0@lo:502: 00000040:00080000:2.0:1787430691.235950:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787430691.235973:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787430691.235986:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787430691.235999:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787430691.236027:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787430691.236042:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787430691.236054:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787430691.236065:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787430691.236077:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787430691.236090:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787430691.236103:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787430691.236116:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787430691.236127:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787430691.236140:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787430691.236152:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787430691.236175:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787430691.236189:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787430691.236204:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787430691.236217:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787430691.236229:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787430691.236252:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787430691.236265:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787430691.236278:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787430691.236291:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787430691.236303:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787430691.236315:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787430691.236326:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787430691.236338:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787430691.236349:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787430691.236359:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787430691.236369:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787430691.236379:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787430691.236391:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787430691.236404:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787430691.236416:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787430691.236429:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787430691.236454:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1787430691.236487:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719680:0@lo:502: 00000100:00100000:2.0:1787430691.236521:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.236547:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719680 00000100:00100000:2.0:1787430691.236552:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719680 00000100:00100000:2.0:1787430691.236572:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787430691.236579:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719680:12345-0@lo:502: 00000100:00100000:2.0:1787430691.236668:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847719680:12345-0@lo:502: Request processed in 89us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.236674:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787430691.236710:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10e61300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430691.236724:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847719680:0@lo:502: 00000040:00080000:2.0:1787430691.236759:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787430691.236766:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787430691.239389:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787430691.239405:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e2c35c48000) 00000020:00000080:2.0:1787430691.239429:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787430691.239510:0:8430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c35f42000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787430691.239514:0:8430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c35f42000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787430691.239517:0:8430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c35f42000 3 00010000:00080000:2.0:1787430691.239559:0:8430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b0287c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430691.241136:0:8430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787430691.241326:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787430691.241367:0:8430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787430691.241379:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4dbb683ba6a93d5b 00000100:00080000:2.0:1787430691.241388:0:8430:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430691.241394:0:8430:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e2b0287c800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430691.241427:0:8430:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c3a638700 x1874256847719808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430691.241454:0:8430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787430691.241832:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847719936:0@lo:400: 00000100:00100000:0.0:1787430691.241899:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430691.241932:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430691.241938:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847720064:0@lo:400: 00000100:00100000:0.0:1787430691.241960:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430691.241990:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719936 00000100:00100000:0.0:1787430691.241996:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719936 00000100:00100000:0.0:1787430691.242031:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720064 00000100:00100000:0.0:1787430691.242035:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720064 00000100:00100000:0.0:1787430691.242052:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430691.242060:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847719936:12345-0@lo:400: 00000100:00100000:0.0:1787430691.242118:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847719936:12345-0@lo:400: Request processed in 58us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.242126:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430691.242141:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430691.242147:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847720064:12345-0@lo:400: 00000100:00100000:0.0:1787430691.242173:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847720064:12345-0@lo:400: Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430691.242179:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787430691.242209:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2c3a4dd500 x1874256847720064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430691.242223:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847720064:0@lo:400: 00010000:00080000:0.0:1787430691.242235:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2c3a4dc000 x1874256847719936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430691.242244:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847719936:0@lo:400: 00000100:00100000:2.0:1787430691.243695:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847720192:0@lo:400: 00000100:00100000:2.0:1787430691.243746:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787430691.243895:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787430691.243908:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e2c35c4cd28) 00000020:00000080:2.0:1787430691.243928:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787430691.244000:0:8430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c35f42000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787430691.244004:0:8430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c35f42000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787430691.244006:0:8430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c35f42000 3 00010000:00080000:2.0:1787430691.244039:0:8430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b0287d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.125@tcp at head 00000100:00100000:3.0:1787430691.244834:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847719808:0@lo:38: 00000100:00100000:3.0:1787430691.244879:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430691.244927:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847719808 00000100:00100000:3.0:1787430691.244934:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847719808 00000100:00100000:3.0:1787430691.244958:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430691.244965:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847719808:12345-0@lo:38: 00010000:00080000:3.0:1787430691.244987:0:6496:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:3.0:1787430691.245017:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4dbb683ba6a93d69 00000004:00100000:3.0:1787430691.245032:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787430691.245062:0:6496:0:(import.c:65:import_set_state_nolock()) ffff8e2c077e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430691.245109:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874256847719808:12345-0@lo:38: Request processed in 143us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.245116:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787430691.245155:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2c3a638700 x1874256847719808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430691.245165:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430691.245172:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787430691.245186:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787430691.245190:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787430691.245193:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787430691.245198:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847719808:0@lo:38: 00010000:00010000:2.0:1787430691.248964:0:8430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787430691.249156:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787430691.249199:0:8430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787430691.249212:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4dbb683ba6a93d70 00000100:00080000:2.0:1787430691.249221:0:8430:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430691.249227:0:8430:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e2b0287d800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430691.249269:0:8430:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c3a63aa00 x1874256847720320/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430691.249289:0:8430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787430691.251216:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720192 00000100:00100000:1.0:1787430691.251225:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720192 00000100:00100000:1.0:1787430691.251270:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787430691.251280:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847720192:12345-0@lo:400: 00000100:00100000:1.0:1787430691.251375:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847720192:12345-0@lo:400: Request processed in 97us (7629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430691.251383:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787430691.251543:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1874256847720320:0@lo:38: 00000100:00100000:3.0:1787430691.251589:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.251705:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847720192:0@lo:400: 00000040:00080000:2.0:1787430691.251799:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1787430691.251843:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787430691.251870:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787430691.251885:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.251896:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787430691.251943:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787430691.251945:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430691.251946:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430691.251948:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430691.251949:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430691.251950:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430691.251952:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430691.251953:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787430691.251955:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787430691.251956:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430691.251958:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787430691.251966:0:8402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787430691.251968:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787430691.251970:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430691.251971:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430691.251972:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430691.251973:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430691.251974:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430691.251974:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430691.251975:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787430691.251976:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787430691.251977:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430691.251978:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787430691.251996:0:8402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787430691.252008:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847720448:0@lo:253: 00000100:00100000:2.0:1787430691.252042:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.252072:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720448 00000100:00100000:2.0:1787430691.252076:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720448 00000100:00100000:2.0:1787430691.252100:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787430691.252106:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847720448:12345-0@lo:253: 20000000:01000000:2.0:1787430691.252127:0:6492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787430691.252139:0:6492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787430691.252248:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10e61840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430691.256074:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720320 00000100:00100000:1.0:1787430691.256085:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720320 00000100:00100000:1.0:1787430691.256132:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430691.256141:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847720320:12345-0@lo:38: 00010000:00080000:1.0:1787430691.256169:0:6496:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1787430691.256217:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4dbb683ba6a93d77 00000004:00100000:1.0:1787430691.256235:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787430691.256268:0:6496:0:(import.c:65:import_set_state_nolock()) ffff8e2c36601800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430691.256349:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874256847720320:12345-0@lo:38: Request processed in 207us (4758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430691.256356:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787430691.256527:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2c3a63aa00 x1874256847720320/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430691.256539:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430691.256548:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787430691.256557:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787430691.256562:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787430691.256564:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787430691.256570:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1874256847720320:0@lo:38: 20000000:01000000:3.0:1787430691.260008:0:6492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787430691.260026:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787430691.260215:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787430691.260220:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787430691.260240:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.260258:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a93c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.260265:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.260271:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.260316:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.260329:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 16 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.260343:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847720576:0@lo:104: 00000100:00100000:0.0:1787430691.260407:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430691.260625:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a93c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430691.260635:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a93c7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 16 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430691.260644:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847720704:0@lo:104: 00000100:00100000:0.0:1787430691.260665:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e5a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430691.260750:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787430691.260770:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430691.260826:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720576 00000100:00100000:1.0:1787430691.260833:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720576 00000100:00100000:3.0:1787430691.260982:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:8402:x1874256847720448:12345-0@lo:253: Request processed in 8874us (8936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430691.260991:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787430691.261052:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720704 00000100:00100000:2.0:1787430691.261056:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720704 00000100:00100000:2.0:1787430691.261076:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430691.261084:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3152c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6513:x1874256847720576:12345-0@lo:104: 00010000:00010000:2.0:1787430691.261096:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261150:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787430691.261156:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3152c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6513:x1874256847720576:12345-0@lo:104: Request processed in 73us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.261163:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430691.261204:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430691.261210:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847720704:12345-0@lo:104: 00010000:00010000:2.0:1787430691.261217:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261252:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787430691.261257:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847720704:12345-0@lo:104: Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.261263:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787430691.261279:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430691.261284:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261290:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01490200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430691.261295:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261303:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430691.261309:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430691.261315:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430691.261339:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261346:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430691.261365:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261383:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a93c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ca5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261397:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430691.261400:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261404:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430691.261407:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261413:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430691.261419:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430691.261423:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430691.261438:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261444:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430691.261458:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261475:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261487:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430691.261494:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430691.261496:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430691.261503:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430691.261515:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847720832:0@lo:103: 00000100:00100000:2.0:1787430691.261543:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.261582:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847720960:0@lo:103: 00000100:00100000:2.0:1787430691.261629:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430691.261668:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720832 00000100:00100000:2.0:1787430691.261672:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720832 00010000:00010000:2.0:1787430691.261689:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 16 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.261708:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847720960 00000100:00100000:2.0:1787430691.261711:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847720960 00010000:00010000:2.0:1787430691.261721:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a93c7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 17 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430691.261734:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430691.261740:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:3628:x1874256847720832:12345-0@lo:103: 00010000:00010000:2.0:1787430691.261749:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430691.261754:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 17 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261763:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 17 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261777:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430691.261804:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:3628:x1874256847720832:12345-0@lo:103: Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.261811:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430691.261831:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430691.261837:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:3629:x1874256847720960:12345-0@lo:103: 00010000:00010000:2.0:1787430691.261845:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430691.261850:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a93c7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 16 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261859:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a93c7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 16 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261871:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261878:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787430691.261891:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006844641s 00010000:00010000:2.0:1787430691.261896:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261903:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261910:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261917:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261922:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430691.261926:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261943:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261953:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430691.261961:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430691.261989:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:3629:x1874256847720960:12345-0@lo:103: Request processed in 152us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430691.261996:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430691.262036:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847720960:0@lo:103: 00000100:00100000:2.0:1787430691.262062:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847720832:0@lo:103: 00000100:00100000:0.0:1787430691.262210:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8402:1874256847720448:0@lo:253: 10000000:01000000:0.0:1787430691.262222:0:8402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787430691.262226:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787430691.262227:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787430691.262228:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430691.262230:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430691.262231:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430691.262232:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430691.262234:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430691.262235:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430691.262237:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430691.262239:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430691.262240:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787430691.262251:0:8402:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787430691.265660:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93c9e expref: 15 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430691.265684:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847720576:0@lo:104: 00010000:00010000:3.0:1787430691.265698:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a93c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93c74 expref: 14 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430691.265707:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847720704:0@lo:104: 00010000:00010000:3.0:1787430691.265745:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.265756:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.265763:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430691.265770:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c00031600/0x4dbb683ba6a93d7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787430691.266735:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787430691.267346:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787430691.267564:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787430691.268071:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787430691.268284:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787430691.268505:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787430691.269797:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787430691.278288:0:8402:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787430691.278297:0:8402:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787430691.278331:0:8402:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787430691.278370:0:8402:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787430691.278390:0:8402:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787430691.278408:0:8402:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787430691.279278:0:8402:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430691.279480:0:8402:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787430691.840160:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787430691.865395:0:8486:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430691.865835:0:8486:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787430692.864040:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430693.120734:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430693.120762:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847721088:0@lo:41: 00000100:00100000:0.0:1787430693.120834:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430693.120948:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721088 00000100:00100000:1.0:1787430693.120956:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721088 00000100:00100000:1.0:1787430693.121005:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787430693.121015:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847721088:12345-0@lo:41: 00000004:00000024:1.0:1787430693.121047:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787430693.121099:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847721088:12345-0@lo:41: Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430693.121107:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787430693.121143:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847721088:0@lo:41: 00010000:00010000:2.0:1787430693.888010:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430694.789089:0:8775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787430694.911996:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787430695.232527:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787430695.232534:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c3a6a2800 from 30 10000000:01000000:3.0:1787430695.232539:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787430695.232586:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.232598:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.232639:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.232665:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721216:0@lo:101: 00000100:00100000:3.0:1787430695.232731:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.232782:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.232784:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721216 00000100:00100000:1.0:1787430695.232792:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721216 00000100:00100000:1.0:1787430695.232847:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430695.232855:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:6494:x1874256847721216:12345-0@lo:101: 00010000:00010000:1.0:1787430695.232868:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430695.232882:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93d85 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.232918:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.232928:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.232935:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013ebc00, rc 0) 00000100:00100000:1.0:1787430695.232986:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847721216:12345-0@lo:101: Request processed in 131us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.232993:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787430695.233189:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721216:0@lo:101: 00010000:00010000:3.0:1787430695.233204:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.233220:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.233283:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721344:0@lo:501: 00000100:00100000:3.0:1787430695.233312:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.233334:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.233353:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721344 00000100:00100000:0.0:1787430695.233357:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721344 00000100:00100000:0.0:1787430695.233384:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787430695.233392:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847721344:12345-0@lo:501: 00000100:00100000:0.0:1787430695.233519:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847721344:12345-0@lo:501: Request processed in 128us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.233524:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787430695.235514:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721344:0@lo:501: 00000100:00100000:3.0:1787430695.235568:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721472:0@lo:503: 00000100:00100000:3.0:1787430695.235656:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.235705:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.235940:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721472 00000100:00100000:1.0:1787430695.235948:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721472 00000100:00100000:1.0:1787430695.236001:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787430695.236011:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847721472:12345-0@lo:503: 00000100:00100000:1.0:1787430695.236170:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847721472:12345-0@lo:503: Request processed in 160us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.236178:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787430695.237997:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721472:0@lo:503: 00000100:00100000:1.0:1787430695.239366:0:8810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8810:1874256847721600:0@lo:502: 00000100:00100000:1.0:1787430695.239449:0:8810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.239497:0:8810:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35ec0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787430695.239549:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721600 00000100:00100000:3.0:1787430695.239557:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721600 00000100:00100000:3.0:1787430695.239638:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787430695.239649:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8810:x1874256847721600:12345-0@lo:502: 00000100:00100000:3.0:1787430695.239770:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8810:x1874256847721600:12345-0@lo:502: Request processed in 123us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430695.239778:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787430695.239917:0:8810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8810:1874256847721600:0@lo:502: 00000100:00100000:1.0:1787430695.239961:0:8810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8810:1874256847721728:0@lo:502: 00000100:00100000:1.0:1787430695.239995:0:8810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.240025:0:8810:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35ec0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787430695.240164:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721728 00000100:00100000:3.0:1787430695.240170:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721728 00000100:00100000:3.0:1787430695.240195:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787430695.240202:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8810:x1874256847721728:12345-0@lo:502: 00000100:00100000:3.0:1787430695.240273:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:8810:x1874256847721728:12345-0@lo:502: Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430695.240282:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787430695.240291:0:8810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8810:1874256847721728:0@lo:502: 00000040:00080000:1.0:1787430695.240323:0:8810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787430695.240551:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787430695.240722:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787430695.240732:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.240744:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430695.240754:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430695.240757:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a2800 from 5 10000000:01000000:3.0:1787430695.240760:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430695.240787:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.240796:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.240805:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.240819:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721856:0@lo:101: 00000100:00100000:3.0:1787430695.240850:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.240883:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.241252:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721856 00000100:00100000:1.0:1787430695.241257:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721856 00000100:00100000:1.0:1787430695.241287:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787430695.241295:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847721856:12345-0@lo:101: 00010000:00010000:1.0:1787430695.241304:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430695.241317:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93d93 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.241335:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.241344:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.241352:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013eb000, rc 0) 00000100:00100000:1.0:1787430695.241381:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847721856:12345-0@lo:101: Request processed in 88us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.241387:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787430695.241415:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721856:0@lo:101: 00010000:00010000:3.0:1787430695.241438:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.241447:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.241500:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721984:0@lo:256: 00000100:00100000:3.0:1787430695.241531:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.241554:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.241655:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847721984 00000100:00100000:1.0:1787430695.241660:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847721984 00000100:00100000:1.0:1787430695.241688:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787430695.241694:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847721984:12345-0@lo:256: 20000000:01000000:1.0:1787430695.241707:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430695.241723:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430695.241726:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787430695.241813:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847721984:12345-0@lo:256: Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.241822:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787430695.241829:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847721984:0@lo:256: 10000000:01000000:3.0:1787430695.241876:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430695.241882:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.241891:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430695.241899:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787430695.241902:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1787430695.241904:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787430695.241919:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.241927:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.241934:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.241947:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847722112:0@lo:101: 00000100:00100000:3.0:1787430695.241973:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.241999:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.242260:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847722112 00000100:00100000:1.0:1787430695.242264:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847722112 00000100:00100000:1.0:1787430695.242283:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787430695.242289:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847722112:12345-0@lo:101: 00010000:00010000:1.0:1787430695.242295:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430695.242304:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93da1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.242318:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.242326:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.242333:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013eb400, rc 0) 00000100:00100000:1.0:1787430695.243282:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847722112:12345-0@lo:101: Request processed in 990us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.243290:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787430695.244907:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847722112:0@lo:101: 00010000:00010000:0.0:1787430695.244928:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.244939:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430695.245011:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847722240:0@lo:501: 00000100:00100000:0.0:1787430695.245061:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.245092:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.245145:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847722240 00000100:00100000:1.0:1787430695.245150:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847722240 00000100:00100000:1.0:1787430695.245202:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787430695.245211:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847722240:12345-0@lo:501: 00000100:00100000:1.0:1787430695.245326:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847722240:12345-0@lo:501: Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.245334:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787430695.245478:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847722240:0@lo:501: 00000100:00100000:0.0:1787430695.245508:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847722368:0@lo:503: 00000100:00100000:0.0:1787430695.245544:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.245565:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.245625:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847722368 00000100:00100000:1.0:1787430695.245630:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847722368 00000100:00100000:1.0:1787430695.245654:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787430695.245661:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847722368:12345-0@lo:503: 00000100:00100000:1.0:1787430695.245738:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847722368:12345-0@lo:503: Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.245745:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787430695.245826:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847722368:0@lo:503: 00000100:00100000:0.0:1787430695.246203:0:8811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8811:1874256847722496:0@lo:502: 00000100:00100000:0.0:1787430695.246237:0:8811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.246266:0:8811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.246368:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847722496 00000100:00100000:1.0:1787430695.246372:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847722496 00000100:00100000:1.0:1787430695.246407:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787430695.246415:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8811:x1874256847722496:12345-0@lo:502: 00000100:00100000:1.0:1787430695.246512:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8811:x1874256847722496:12345-0@lo:502: Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.246519:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787430695.246809:0:8811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8811:1874256847722496:0@lo:502: 00000020:01000000:2.0:1787430695.246838:0:8811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787430695.246845:0:8811:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787430695.246852:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430695.246854:0:8811:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787430695.246860:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787430695.246864:0:8811:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:2.0:1787430695.246886:0:8811:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787430695.246888:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430695.246903:0:8811:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e2c35c4b370) 00000020:00000080:2.0:1787430695.246923:0:8811:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787430695.246929:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787430695.247005:0:8811:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787430695.247011:0:8811:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787430695.247017:0:8811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a93db6 00010000:00080000:2.0:1787430695.247047:0:8811:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c35c12800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430695.247335:0:8811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787430695.265652:0:8811:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787430695.265676:0:8811:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787430695.266073:0:8811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430695.266280:0:8811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430695.266362:0:8811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787430695.266456:0:8811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787430695.271838:0:8814:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430695.271856:0:8814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787430695.280655:0:8811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787430695.280669:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787430695.280716:0:8811:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787430695.280742:0:8811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a93dbd 00000100:00080000:1.0:1787430695.280753:0:8811:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430695.280759:0:8811:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e2c35c12800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430695.280804:0:8811:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c315af100 x1874256847722624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430695.280833:0:8811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787430695.280874:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847722624:0@lo:8: 00000020:01000000:1.0:1787430695.280936:0:8811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430695.280946:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430695.280948:0:8811:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787430695.280954:0:8811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1787430695.280955:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787430695.280959:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430695.280962:0:8811:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787430695.280966:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787430695.280969:0:8811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787430695.280982:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847722752:0@lo:400: 00000100:00100000:1.0:1787430695.280991:0:8811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8811:1874256847723520:0@lo:502: 00000100:00100000:2.0:1787430695.281020:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.281035:0:8811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.281045:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847722624 00000100:00100000:2.0:1787430695.281049:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847723264:0@lo:400: 00000100:00100000:1.0:1787430695.281049:0:8811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35e0e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.281053:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847722624 00000100:00100000:2.0:1787430695.281079:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.281100:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430695.281106:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787430695.281108:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1874256847722624:12345-0@lo:8: 00000100:00100000:2.0:1787430695.281116:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847722880:0@lo:400: 00010000:00080000:0.0:1787430695.281135:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000100:00100000:2.0:1787430695.281149:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787430695.281167:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a93dc4 00000100:00100000:2.0:1787430695.281172:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847723392:0@lo:400: 00002000:00100000:0.0:1787430695.281200:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e2b021ac800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787430695.281206:0:8408:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000100:00100000:2.0:1787430695.281215:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1787430695.281216:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787430695.281245:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847723008:0@lo:400: 00000100:00100000:2.0:1787430695.281272:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1787430695.281284:0:8408:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787430695.281297:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787430695.281305:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847723136:0@lo:400: 00000100:00100000:2.0:1787430695.281337:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430695.281382:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847722752 00000100:00100000:1.0:1787430695.281386:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847722880 00000100:00100000:2.0:1787430695.281387:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847722752 00000100:00100000:1.0:1787430695.281394:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847722880 00000100:00100000:2.0:1787430695.281420:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723264 00000100:00100000:2.0:1787430695.281423:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723264 00000100:00100000:1.0:1787430695.281450:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723136 00000100:00100000:1.0:1787430695.281455:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723136 00000100:00100000:2.0:1787430695.281468:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723392 00000100:00100000:2.0:1787430695.281472:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723392 00000100:00100000:1.0:1787430695.281485:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430695.281495:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723008 00000100:00100000:1.0:1787430695.281497:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847722880:12345-0@lo:400: 00000100:00100000:2.0:1787430695.281499:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723008 00000100:00100000:2.0:1787430695.281525:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787430695.281534:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847722752:12345-0@lo:400: 00000100:00100000:1.0:1787430695.281573:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847722880:12345-0@lo:400: Request processed in 79us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430695.281583:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847722752:12345-0@lo:400: Request processed in 52us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430695.281598:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430695.281628:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430695.281639:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787430695.281647:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847723264:12345-0@lo:400: 00000100:00100000:1.0:1787430695.281653:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00002000:00080000:0.0:1787430695.281653:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1787430695.281666:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847723136:12345-0@lo:400: 00000100:00080000:0.0:1787430695.281682:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8e2b021a8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430695.281685:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847723264:12345-0@lo:400: Request processed in 39us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430695.281692:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787430695.281705:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787430695.281712:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847723392:12345-0@lo:400: 00000100:00100000:1.0:1787430695.281732:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847723136:12345-0@lo:400: Request processed in 68us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.281742:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787430695.281749:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1874256847722624:12345-0@lo:8: Request processed in 638us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430695.281757:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847723392:12345-0@lo:400: Request processed in 42us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.281762:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430695.281769:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787430695.281787:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430695.281792:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787430695.281793:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847723008:12345-0@lo:400: 00000100:00100000:0.0:1787430695.281802:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787430695.281825:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847723008:12345-0@lo:400: Request processed in 33us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430695.281829:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430695.281840:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723520 00000100:00100000:0.0:1787430695.281845:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723520 00000100:00100000:2.0:1787430695.281879:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847723136:0@lo:400: 00000100:00100000:0.0:1787430695.281895:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1787430695.281899:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a63bb80 x1874256847723008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430695.281908:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8811:x1874256847723520:12345-0@lo:502: 00000100:00100000:2.0:1787430695.281915:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847723008:0@lo:400: 00000100:00100000:2.0:1787430695.281950:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847722880:0@lo:400: 00010000:00080000:2.0:1787430695.281958:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a63a300 x1874256847723392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430695.281964:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847723392:0@lo:400: 00010000:00080000:2.0:1787430695.281970:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a639880 x1874256847722752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430695.281975:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847722752:0@lo:400: 00010000:00080000:2.0:1787430695.281981:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a63a680 x1874256847723264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430695.281985:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847723264:0@lo:400: 00000100:00100000:0.0:1787430695.282033:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:8811:x1874256847723520:12345-0@lo:502: Request processed in 129us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.282048:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787430695.282060:0:8811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8811:1874256847723520:0@lo:502: 00000100:00080000:0.0:1787430695.282088:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430695.282093:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1787430695.282097:0:8811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430695.282103:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430695.282105:0:8811:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787430695.282110:0:8811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00010000:00080000:0.0:1787430695.282118:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c315af100 x1874256847722624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430695.282128:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430695.282134:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787430695.282142:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787430695.282147:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787430695.282149:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c12800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787430695.282171:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787430695.282176:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847722624:0@lo:8: 00000100:00100000:0.0:1787430695.282215:0:8816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847723648:0@lo:700: 00000100:00100000:0.0:1787430695.282242:0:8816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787430695.282263:0:8814:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787430695.282275:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723648 00000100:00100000:0.0:1787430695.282280:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723648 00000100:00100000:0.0:1787430695.282313:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1787430695.282314:0:8814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 156754711353ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787430695.282322:0:8814:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787430695.282326:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8816:x1874256847723648:12345-0@lo:700: 00000100:00100000:0.0:1787430695.282355:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8417:1874256847723776:0@lo:700: 00000100:00100000:0.0:1787430695.282392:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.282413:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1480 going to sleep for 11 seconds 00000100:00080000:0.0:1787430695.282437:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430695.282455:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723776 00000100:00100000:0.0:1787430695.282459:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723776 00000100:00100000:0.0:1787430695.282488:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430695.282496:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8417:x1874256847723776:12345-0@lo:700: 00000100:00100000:0.0:1787430695.282587:0:8816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1780 going to sleep for 11 seconds 00000020:01000000:0.0:1787430695.282754:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1787430695.282782:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787430695.282793:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.282803:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430695.282814:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787430695.282817:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c04f2d000 from 30 10000000:01000000:0.0:1787430695.282820:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430695.282844:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.282852:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.282862:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430695.282875:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847723904:0@lo:101: 00000100:00100000:0.0:1787430695.282907:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.282935:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.282953:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847723904 00000100:00100000:0.0:1787430695.282957:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847723904 00000100:00100000:0.0:1787430695.282990:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787430695.282999:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847723904:12345-0@lo:101: 00010000:00010000:0.0:1787430695.283008:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430695.283027:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93dcb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.283048:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.283059:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.283068:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030c00, rc 0) 00000100:00100000:0.0:1787430695.283105:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847723904:12345-0@lo:101: Request processed in 107us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.283111:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787430695.283142:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847723904:0@lo:101: 00010000:00010000:1.0:1787430695.283156:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.283166:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430695.283228:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724032:0@lo:501: 00000100:00100000:1.0:1787430695.283266:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.283284:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35e0e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.283302:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724032 00000100:00100000:0.0:1787430695.283308:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724032 00000100:00100000:0.0:1787430695.283334:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787430695.283343:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847724032:12345-0@lo:501: 00000100:00100000:0.0:1787430695.283448:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847724032:12345-0@lo:501: Request processed in 106us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.283455:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787430695.283462:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724032:0@lo:501: 00000100:00100000:1.0:1787430695.283491:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724160:0@lo:503: 00000100:00100000:1.0:1787430695.283533:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787430695.283541:0:7427:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787430695.283552:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35e0e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.283558:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724160 00000100:00100000:0.0:1787430695.283563:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724160 00000100:00100000:0.0:1787430695.283594:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787430695.283623:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847724160:12345-0@lo:503: 00000100:00100000:0.0:1787430695.283706:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847724160:12345-0@lo:503: Request processed in 104us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.283713:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787430695.283722:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724160:0@lo:503: 00000100:00100000:1.0:1787430695.283918:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8820:1874256847724288:0@lo:502: 00000100:00100000:1.0:1787430695.283957:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.283992:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724288 00000100:00100000:1.0:1787430695.283995:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35e0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.283998:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724288 00000100:00100000:0.0:1787430695.284037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787430695.284045:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:8820:x1874256847724288:12345-0@lo:502: 00000100:00100000:0.0:1787430695.284121:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:8820:x1874256847724288:12345-0@lo:502: Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.284128:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787430695.284139:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8820:1874256847724288:0@lo:502: 00000100:00100000:1.0:1787430695.284184:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8820:1874256847724416:0@lo:502: 00000100:00100000:1.0:1787430695.284216:0:8820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.284279:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724416 00000100:00100000:0.0:1787430695.284283:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724416 00000100:00100000:1.0:1787430695.284285:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35e0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.284308:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787430695.284330:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:8820:x1874256847724416:12345-0@lo:502: 00000100:00100000:0.0:1787430695.284391:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:8820:x1874256847724416:12345-0@lo:502: Request processed in 64us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.284398:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787430695.284405:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8820:1874256847724416:0@lo:502: 00000040:00080000:1.0:1787430695.284443:0:8820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787430695.284488:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787430695.284511:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430695.284518:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.284527:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430695.284536:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787430695.284538:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c04f2d000 from 5 10000000:01000000:0.0:1787430695.284541:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787430695.284560:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.284567:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.284587:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430695.284617:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724544:0@lo:101: 00000100:00100000:0.0:1787430695.284643:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.284660:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.284699:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724544 00000100:00100000:1.0:1787430695.284711:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724544 00000100:00100000:1.0:1787430695.284738:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787430695.284746:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847724544:12345-0@lo:101: 00010000:00010000:1.0:1787430695.284755:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430695.284766:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93dd9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.284782:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.284790:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.284798:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013ea200, rc 0) 00000100:00100000:1.0:1787430695.284832:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847724544:12345-0@lo:101: Request processed in 86us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.284840:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724544:0@lo:101: 00000100:00100000:1.0:1787430695.284841:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:0.0:1787430695.284856:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.284865:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430695.284900:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724672:0@lo:256: 00000100:00100000:0.0:1787430695.284926:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.284954:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724672 00000100:00100000:0.0:1787430695.284957:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.284960:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724672 00000100:00100000:1.0:1787430695.284999:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787430695.285007:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847724672:12345-0@lo:256: 20000000:01000000:1.0:1787430695.285019:0:6489:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430695.285035:0:6489:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430695.285039:0:6489:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787430695.285243:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847724672:12345-0@lo:256: Request processed in 236us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.285248:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724672:0@lo:256: 00000100:00100000:1.0:1787430695.285253:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 10000000:01000000:0.0:1787430695.285298:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787430695.285304:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.285311:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430695.285318:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787430695.285320:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787430695.285328:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787430695.285344:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.285352:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.285360:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430695.285372:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724800:0@lo:101: 00000100:00100000:0.0:1787430695.285397:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.285418:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.285442:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724800 00000100:00100000:1.0:1787430695.285447:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724800 00000100:00100000:1.0:1787430695.285487:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787430695.285495:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847724800:12345-0@lo:101: 00010000:00010000:1.0:1787430695.285502:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430695.285511:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93de7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.285523:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.285528:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430695.285533:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013eaa00, rc 0) 00000100:00100000:1.0:1787430695.285573:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847724800:12345-0@lo:101: Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.285580:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787430695.285702:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724800:0@lo:101: 00010000:00010000:3.0:1787430695.285719:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.285739:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.285799:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724928:0@lo:501: 00000100:00100000:3.0:1787430695.285841:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.285872:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.285896:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847724928 00000100:00100000:1.0:1787430695.285902:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847724928 00000100:00100000:1.0:1787430695.285953:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787430695.285962:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847724928:12345-0@lo:501: 00000100:00100000:1.0:1787430695.286064:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847724928:12345-0@lo:501: Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.286071:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787430695.286095:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847724928:0@lo:501: 00000100:00100000:3.0:1787430695.286123:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847725056:0@lo:503: 00000100:00100000:3.0:1787430695.286158:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.286186:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.286232:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725056 00000100:00100000:1.0:1787430695.286236:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725056 00000100:00100000:1.0:1787430695.286263:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787430695.286270:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847725056:12345-0@lo:503: 00000100:00100000:1.0:1787430695.286353:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847725056:12345-0@lo:503: Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.286367:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787430695.286541:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847725056:0@lo:503: 00000100:00100000:1.0:1787430695.286906:0:8822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8822:1874256847725184:0@lo:502: 00000100:00100000:1.0:1787430695.286942:0:8822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.286975:0:8822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.286979:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725184 00000100:00100000:0.0:1787430695.286986:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725184 00000100:00100000:0.0:1787430695.287022:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787430695.287030:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:8822:x1874256847725184:12345-0@lo:502: 00000100:00100000:0.0:1787430695.287129:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:8822:x1874256847725184:12345-0@lo:502: Request processed in 99us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.287137:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787430695.287152:0:8822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8822:1874256847725184:0@lo:502: 00000020:01000000:1.0:1787430695.287228:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787430695.287235:0:8822:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787430695.287241:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430695.287243:0:8822:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787430695.287249:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787430695.287252:0:8822:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1787430695.287278:0:8822:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787430695.287282:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787430695.287297:0:8822:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e2c35decd28) 00000020:00000080:1.0:1787430695.287320:0:8822:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1787430695.287327:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 40000000:02000000:3.0:1787430695.287359:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000004:00080000:1.0:1787430695.287419:0:8822:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787430695.287437:0:8822:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787430695.287445:0:8822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93dfc 00010000:00080000:1.0:1787430695.287478:0:8822:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c363af800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1787430695.287791:0:8822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1787430695.291512:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8417:x1874256847723776:12345-0@lo:700: Request processed in 9012us (9115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430695.291653:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787430695.291793:0:8417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a4dfb80 x1874256847723776/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430695.291811:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8417:1874256847723776:0@lo:700: 40000000:02000000:0.0:1787430695.291825:0:8417:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1787430695.297459:0:8822:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787430695.297482:0:8822:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787430695.297899:0:8822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430695.298139:0:8822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00100000:1.0:1787430695.298246:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:00080000:0.0:1787430695.298279:0:8822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787430695.298391:0:8822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:2.0:1787430695.298399:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8816:x1874256847723648:12345-0@lo:700: Request processed in 16071us (16150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430695.298416:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787430695.298422:0:8816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a4de300 x1874256847723648/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430695.298450:0:8816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847723648:0@lo:700: 00000040:00080000:2.0:1787430695.298940:0:8825:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430695.298945:0:8825:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787430695.299358:0:8822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430695.299370:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787430695.299407:0:8822:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787430695.299450:0:8822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a93e03 00000100:00080000:0.0:1787430695.299458:0:8822:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787430695.299464:0:8822:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2c363af800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430695.299494:0:8822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c3a4dfb80 x1874256847725312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787430695.299520:0:8822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787430695.299553:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847725312:0@lo:8: 00000020:01000000:0.0:1787430695.299595:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430695.299627:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430695.299629:0:8822:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787430695.299634:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430695.299640:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430695.299642:0:8822:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787430695.299645:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787430695.299648:0:8822:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787430695.299674:0:8822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8822:1874256847725440:0@lo:502: 00000100:00100000:2.0:1787430695.299681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430695.299724:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725312 00000100:00100000:2.0:1787430695.299730:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725312 00000100:00100000:0.0:1787430695.299730:0:8822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430695.299758:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430695.299760:0:8822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430695.299766:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1874256847725312:12345-0@lo:8: 00000100:00100000:1.0:1787430695.299766:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725440 00000100:00100000:1.0:1787430695.299773:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725440 00010000:00080000:2.0:1787430695.299797:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000100:00100000:1.0:1787430695.299824:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000020:00000080:2.0:1787430695.299826:0:8411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a93e0a 00000100:00100000:1.0:1787430695.299835:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:8822:x1874256847725440:12345-0@lo:502: 00002000:00100000:2.0:1787430695.299843:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e2c35c13000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787430695.299849:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787430695.299852:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787430695.299917:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787430695.299949:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8e2c315de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430695.299953:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:8822:x1874256847725440:12345-0@lo:502: Request processed in 119us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.299963:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787430695.299978:0:8822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:8822:1874256847725440:0@lo:502: 00000020:01000000:0.0:1787430695.300003:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430695.300008:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430695.300010:0:8822:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787430695.300015:0:8822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787430695.300067:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1874256847725312:12345-0@lo:8: Request processed in 300us (385us total) trans 0 rc 0/0 00000020:01000000:3.0:1787430695.300074:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1787430695.300075:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:3.0:1787430695.300109:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787430695.300119:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.300130:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430695.300140:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787430695.300149:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e2c10964d28 from 1 10000000:01000000:3.0:1787430695.300152:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787430695.300176:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.300184:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.300193:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.300206:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847725568:0@lo:101: 00000100:00100000:3.0:1787430695.300240:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.300258:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.300276:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725568 00000100:00100000:0.0:1787430695.300281:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725568 00010000:00080000:3.0:1787430695.300296:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a4dfb80 x1874256847725312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430695.300306:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1787430695.300312:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787430695.300313:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787430695.300321:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1787430695.300329:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847725568:12345-0@lo:101: 00000100:00080000:3.0:1787430695.300334:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787430695.300337:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c363af800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1787430695.300339:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430695.300353:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93e11 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430695.300360:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787430695.300367:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847725312:0@lo:8: 00010000:00010000:0.0:1787430695.300375:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430695.300388:0:8825:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:0.0:1787430695.300388:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430695.300400:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031a00, rc 0) 00000100:00100000:0.0:1787430695.300450:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847725568:12345-0@lo:101: Request processed in 124us (209us total) trans 0 rc 0/0 00000004:00080000:3.0:1787430695.300453:0:8825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 156772850154ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787430695.300459:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00080000:00080000:3.0:1787430695.300462:0:8825:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787430695.302007:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847725568:0@lo:101: 00010000:00010000:3.0:1787430695.302023:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.302037:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430695.302085:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847725696:0@lo:501: 00000100:00100000:3.0:1787430695.302122:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.302151:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.302170:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725696 00000100:00100000:1.0:1787430695.302177:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725696 00000100:00100000:1.0:1787430695.302220:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787430695.302230:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847725696:12345-0@lo:501: 00000100:00100000:1.0:1787430695.302312:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847725696:12345-0@lo:501: Request processed in 83us (188us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430695.302320:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787430695.302792:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847725696:0@lo:501: 10000000:01000000:3.0:1787430695.302821:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787430695.302826:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430695.302832:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430695.303866:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787430695.308662:0:8816:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787430695.308687:0:8816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847725952:0@lo:7: 00000100:00100000:0.0:1787430695.308748:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430695.308760:0:8816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.308768:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847725824:0@lo:13: 00000100:00100000:1.0:1787430695.308807:0:8816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.308813:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.308834:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725952 00000100:00100000:1.0:1787430695.308842:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725952 00000100:00100000:0.0:1787430695.308868:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847725824 00000100:00100000:0.0:1787430695.308873:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847725824 00000100:00100000:1.0:1787430695.308900:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430695.308909:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8816:x1874256847725952:12345-0@lo:7: 00000100:00100000:0.0:1787430695.308918:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430695.308929:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1874256847725824:12345-0@lo:13: 00002000:00000024:0.0:1787430695.308952:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1787430695.309007:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1874256847725824:12345-0@lo:13: Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.309014:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787430695.309038:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c315ac700 x1874256847725824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430695.309057:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847725824:0@lo:13: 00000004:00080000:3.0:1787430695.309346:0:8826:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787430695.309350:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847726080:0@lo:13: 00000100:00100000:3.0:1787430695.309361:0:8826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726208:0@lo:7: 00000100:00100000:2.0:1787430695.309377:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.309383:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430695.309396:0:8826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430695.309412:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726080 00000100:00100000:3.0:1787430695.309416:0:8411:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787430695.309416:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726080 00000100:00100000:3.0:1787430695.309423:0:8411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787430695.309470:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430695.309478:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1874256847726080:12345-0@lo:13: 00002000:00000024:2.0:1787430695.309494:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787430695.309523:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726208 00000100:00100000:3.0:1787430695.309527:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726208 00000100:00100000:2.0:1787430695.309534:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847726080:12345-0@lo:13: Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430695.309541:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787430695.309575:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c11578380 x1874256847726080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430695.309590:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847726080:0@lo:13: 00000100:00100000:3.0:1787430695.309681:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430695.309691:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8826:x1874256847726208:12345-0@lo:7: 00000100:00080000:2.0:1787430695.310760:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787430695.312923:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787430695.312930:0:8408:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787430695.313019:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8816:x1874256847725952:12345-0@lo:7: Request processed in 4107us (4256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.313029:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787430695.313215:0:8816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c315aed80 x1874256847725952/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430695.313236:0:8816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847725952:0@lo:7: 00000004:00080000:0.0:1787430695.313250:0:8816:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787430695.313292:0:8816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847726336:0@lo:5: 00000100:00100000:0.0:1787430695.313335:0:8816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.313369:0:8816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.313379:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726336 00000100:00100000:1.0:1787430695.313393:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726336 00000100:00100000:1.0:1787430695.313461:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430695.313473:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8816:x1874256847726336:12345-0@lo:5: 00002000:00080000:1.0:1787430695.313497:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787430695.313539:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8816:x1874256847726336:12345-0@lo:5: Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.313546:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787430695.313557:0:8816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a4dfb80 x1874256847726336/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430695.313567:0:8816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847726336:0@lo:5: 00000004:00080000:0.0:1787430695.313577:0:8816:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787430695.313651:0:8816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847726464:0@lo:5: 00000100:00100000:0.0:1787430695.313684:0:8816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.313707:0:8816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.313712:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726464 00000100:00100000:1.0:1787430695.313718:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726464 00000100:00100000:1.0:1787430695.313750:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430695.313761:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8816:x1874256847726464:12345-0@lo:5: 00002000:00080000:1.0:1787430695.313786:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787430695.316474:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8816:x1874256847726464:12345-0@lo:5: Request processed in 2709us (2783us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787430695.316485:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787430695.316561:0:8816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a4dfb80 x1874256847726464/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430695.316592:0:8816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8816:1874256847726464:0@lo:5: 00000004:00080000:0.0:1787430695.316625:0:8816:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787430695.316662:0:8816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8816:1874256847726592:0@lo:900: 00000100:00100000:0.0:1787430695.316696:0:8816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.316729:0:8816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03ea10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430695.316753:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726592 00000100:00100000:0.0:1787430695.316758:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726592 00000100:00100000:0.0:1787430695.316799:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430695.316809:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8816:x1874256847726592:12345-0@lo:900: 00000100:00100000:0.0:1787430695.316868:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8816:x1874256847726592:12345-0@lo:900: Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.316876:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787430695.316888:0:8816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a4dea00 x1874256847726592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430695.316897:0:8816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8816:1874256847726592:0@lo:900: 00002000:00080000:3.0:1787430695.318498:0:8830:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787430695.318506:0:8830:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787430695.318575:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8826:x1874256847726208:12345-0@lo:7: Request processed in 8884us (9188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430695.318584:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787430695.318634:0:8826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c11579180 x1874256847726208/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430695.318644:0:8826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726208:0@lo:7: 00000004:00080000:2.0:1787430695.318655:0:8826:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787430695.318679:0:8826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726720:0@lo:5: 00000100:00100000:2.0:1787430695.318704:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430695.318734:0:8826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03b5c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430695.318742:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726720 00000100:00100000:3.0:1787430695.318749:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726720 00000100:00100000:3.0:1787430695.318785:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430695.318794:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8826:x1874256847726720:12345-0@lo:5: 00002000:00080000:3.0:1787430695.318815:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787430695.318818:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1787430695.321568:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1787430695.321587:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787430695.321596:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787430695.321754:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8826:x1874256847726720:12345-0@lo:5: Request processed in 2958us (3045us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787430695.321765:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787430695.321781:0:8826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3f86c700 x1874256847726720/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430695.321793:0:8826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787430695.321800:0:8826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726720:0@lo:5: 00000004:00080000:2.0:1787430695.321815:0:8826:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787430695.321858:0:8826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726848:0@lo:700: 00000100:00100000:2.0:1787430695.322119:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430695.322163:0:8826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03b5c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430695.322345:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726848 00000100:00100000:1.0:1787430695.322353:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726848 00000100:00100000:1.0:1787430695.322393:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430695.322403:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8826:x1874256847726848:12345-0@lo:700: 00000020:00000004:2.0:1787430695.331824:0:8837:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1787430695.331875:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8826:x1874256847726848:12345-0@lo:700: Request processed in 9468us (9977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.331889:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787430695.331905:0:8826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3f86c700 x1874256847726848/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430695.331922:0:8826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726848:0@lo:700: 00000020:00000004:2.0:1787430695.332129:0:8837:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000004:02000040:3.0:1787430695.333238:0:8826:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1787430695.336372:0:8826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726976:0@lo:5: 00000100:00100000:3.0:1787430695.336456:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430695.336499:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847726976 00000100:00100000:3.0:1787430695.336502:0:8826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430695.336508:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847726976 00000100:00100000:2.0:1787430695.336562:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787430695.336576:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8826:x1874256847726976:12345-0@lo:5: 00002000:00080000:2.0:1787430695.340531:0:8409:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787430695.340551:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787430695.342350:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8826:x1874256847726976:12345-0@lo:5: Request processed in 5774us (5889us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787430695.342362:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787430695.342444:0:8826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c11579880 x1874256847726976/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430711 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430695.342463:0:8826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8826:1874256847726976:0@lo:5: 00000004:00080000:0.0:1787430695.342481:0:8826:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1787430695.680011:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430695.680035:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847727104:0@lo:41: 00000100:00100000:0.0:1787430695.680106:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430695.680149:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847727104 00000100:00100000:1.0:1787430695.680157:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847727104 00000100:00100000:1.0:1787430695.680343:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430695.680368:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847727104:12345-0@lo:41: 00000004:00000024:1.0:1787430695.680400:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787430695.680461:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847727104:12345-0@lo:41: Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430695.680469:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430695.680524:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847727104:0@lo:41: 00000001:00080000:0.0:1787430695.768807:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787430695.935805:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430696.959720:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787430697.232067:0:8939:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430697.232283:0:8939:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787430697.687472:0:8987:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430697.687481:0:8987:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787430697.983938:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430698.239854:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430698.239885:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847727232:0@lo:41: 00000100:00100000:2.0:1787430698.239949:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430698.240059:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847727232 00000100:00100000:1.0:1787430698.240067:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847727232 00000100:00100000:1.0:1787430698.240140:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787430698.240150:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847727232:12345-0@lo:41: 00000004:00000024:1.0:1787430698.240188:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787430698.240234:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847727232:12345-0@lo:41: Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430698.240241:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430698.240278:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847727232:0@lo:41: 00010000:00010000:2.0:1787430699.009295:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430700.031717:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430700.799737:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847727360:0@lo:13: 00000100:00100000:3.0:1787430700.799756:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847727616:0@lo:41: 00000100:00100000:2.0:1787430700.799883:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430700.799923:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847727360 00000100:00100000:0.0:1787430700.799931:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847727360 00000100:00100000:0.0:1787430700.799987:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430700.799998:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847727360:12345-0@lo:13: 00000100:00100000:3.0:1787430700.800008:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787430700.800029:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430700.800057:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847727872:0@lo:400: 00000100:00100000:3.0:1787430700.800058:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847728128:0@lo:400: 00000100:00100000:0.0:1787430700.800091:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847727360:12345-0@lo:13: Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430700.800099:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430700.800128:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430700.800131:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847727488:0@lo:13: 00000100:00100000:3.0:1787430700.800177:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847728640:0@lo:400: 00000100:00100000:0.0:1787430700.800198:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728128 00000100:00100000:0.0:1787430700.800203:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728128 00000100:00100000:3.0:1787430700.800213:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430700.800234:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430700.800250:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847728128:12345-0@lo:400: 00000100:00100000:3.0:1787430700.800262:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787430700.800271:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847727744:0@lo:400: 00000100:00100000:3.0:1787430700.800313:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430700.800335:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847728256:0@lo:400: 00000100:00100000:3.0:1787430700.800357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430700.800372:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847728768:0@lo:400: 00000100:00100000:3.0:1787430700.800403:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787430700.800432:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03490a80 x1874256847728128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430700.800443:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847728128:0@lo:400: 00000100:00100000:3.0:1787430700.800471:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847727616 00000100:00100000:3.0:1787430700.800475:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847727616 00000100:00100000:3.0:1787430700.800503:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728256 00000100:00100000:3.0:1787430700.800507:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728256 00000100:00100000:3.0:1787430700.800522:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430700.800526:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847727616:12345-0@lo:41: 00000004:00000024:3.0:1787430700.800559:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787430700.800596:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847727616:12345-0@lo:41: Request processed in 69us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430700.800615:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430700.800626:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430700.800631:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847728256:12345-0@lo:400: 00000100:00100000:3.0:1787430700.800651:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847728256:12345-0@lo:400: Request processed in 21us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430700.800655:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430700.800677:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728640 00000100:00100000:3.0:1787430700.800681:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728640 00000100:00100000:3.0:1787430700.800713:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728768 00000100:00100000:3.0:1787430700.800716:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728768 00000100:00100000:3.0:1787430700.800749:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430700.800756:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847728640:12345-0@lo:400: 00000100:00100000:3.0:1787430700.800801:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847728640:12345-0@lo:400: Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430700.800807:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430700.800821:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430700.800827:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847728768:12345-0@lo:400: 00000100:00100000:3.0:1787430700.800851:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847728768:12345-0@lo:400: Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430700.800856:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430700.800886:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847728256:0@lo:400: 00010000:00080000:3.0:1787430700.800896:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03490380 x1874256847728768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430700.800905:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787430700.800917:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847728768:0@lo:400: 00010000:00080000:3.0:1787430700.800928:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03491c00 x1874256847728640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430700.800935:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787430700.800944:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847728640:0@lo:400: 00000100:00100000:3.0:1787430700.800959:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847727616:0@lo:41: 00000100:00100000:1.0:1787430700.801657:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847727744 00000100:00100000:1.0:1787430700.801663:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847727744 00000100:00100000:1.0:1787430700.801693:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787430700.801700:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3627:x1874256847727744:12345-0@lo:400: 00000100:00100000:1.0:1787430700.801736:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3627:x1874256847727744:12345-0@lo:400: Request processed in 37us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430700.801743:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787430700.801877:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847727744:0@lo:400: 00000100:00080000:3.0:1787430700.802697:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430700.802719:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430700.802751:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847728384:0@lo:400: 00000100:00100000:3.0:1787430700.802784:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787430700.802862:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3f86c000 x1874256847727360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430700.802879:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847727360:0@lo:13: 00000100:00100000:2.0:1787430700.803469:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430700.803494:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847728000:0@lo:400: 00000100:00100000:2.0:1787430700.803520:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430700.803548:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847728512:0@lo:400: 00000100:00100000:2.0:1787430700.803575:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430700.803637:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847727872 00000100:00100000:2.0:1787430700.803642:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847727872 00000100:00100000:2.0:1787430700.803670:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728384 00000100:00100000:2.0:1787430700.803673:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728384 00000100:00100000:2.0:1787430700.803699:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728512 00000100:00100000:0.0:1787430700.803702:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847728128:12345-0@lo:400: Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430700.803703:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728512 00000100:00100000:0.0:1787430700.803714:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787430700.803732:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430700.803740:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430700.803745:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847727872:12345-0@lo:400: 00000100:00100000:0.0:1787430700.803751:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847728384:12345-0@lo:400: 00000100:00100000:2.0:1787430700.803813:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847727872:12345-0@lo:400: Request processed in 71us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430700.803813:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847728384:12345-0@lo:400: Request processed in 65us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430700.803825:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430700.803835:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430700.803843:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430700.803852:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847728512:12345-0@lo:400: 00000100:00100000:2.0:1787430700.803861:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728000 00000100:00100000:2.0:1787430700.803866:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728000 00000100:00100000:0.0:1787430700.803890:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847728512:12345-0@lo:400: Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430700.803897:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787430700.803899:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787430700.803908:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03492680 x1874256847727872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430700.803911:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847728000:12345-0@lo:400: 00000100:00100000:3.0:1787430700.803925:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847727872:0@lo:400: 00010000:00080000:3.0:1787430700.803939:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03490e00 x1874256847728384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430700.803946:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847728384:0@lo:400: 00000100:00100000:2.0:1787430700.803961:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847728000:12345-0@lo:400: Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430700.803968:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787430700.803990:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430700.803994:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430700.805659:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847727488 00000100:00100000:3.0:1787430700.805669:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847727488 00000100:00100000:3.0:1787430700.805707:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430700.805716:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847727488:12345-0@lo:13: 00002000:00000024:3.0:1787430700.805735:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430700.805784:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847727488:12345-0@lo:13: Request processed in 69us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430700.805803:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787430700.806569:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03491500 x1874256847727488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430700.806589:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847727488:0@lo:13: 00000100:00100000:0.0:1787430700.806621:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847728000:0@lo:400: 00010000:00080000:0.0:1787430700.806636:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03491180 x1874256847728512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430700.806645:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847728512:0@lo:400: 00010000:00010000:2.0:1787430701.055802:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430702.079921:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787430702.489754:0:9484:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787430702.489757:0:9484:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787430702.489759:0:9484:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787430702.489890:0:9484:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2c363a8000 00000020:01000004:1.0:1787430702.489904:0:9484:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787430702.489918:0:9484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787430702.489931:0:9484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e2c35deb370) 00000020:00000080:1.0:1787430702.489946:0:9484:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787430702.538186:0:9484:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787430702.538235:0:9484:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1787430702.554402:0:9484:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787430702.554647:0:9484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787430702.554661:0:9484:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787430702.554674:0:9484:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4dbb683ba6a93e26 00000020:01000004:2.0:1787430702.554686:0:9484:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787430702.554709:0:9484:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787430702.554713:0:9484:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787430702.554720:0:9484:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787430702.554749:0:9484:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787430702.554754:0:9484:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787430702.570633:0:9484:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787430702.570663:0:9484:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787430702.570668:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787430702.570670:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787430702.570671:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430702.570672:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430702.570673:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430702.570674:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430702.570675:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430702.570677:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787430702.570677:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787430702.570679:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430702.570679:0:9484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787430702.570683:0:9484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787430702.570684:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787430702.570685:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787430702.570685:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430702.570686:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430702.570686:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430702.570687:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430702.570688:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430702.570688:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787430702.570689:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787430702.570689:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430702.570690:0:9484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430702.570768:0:9484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787430702.570851:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847728896:0@lo:253: 00000100:00100000:3.0:1787430702.570921:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.570972:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430702.571024:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847728896 00000100:00100000:1.0:1787430702.571040:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847728896 00000100:00100000:1.0:1787430702.571102:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787430702.571112:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:9484:x1874256847728896:12345-0@lo:253: 20000000:01000000:1.0:1787430702.571142:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787430702.571145:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787430702.571150:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787430702.571153:0:6492:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787430702.571588:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430702.571994:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1787430702.572013:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787430702.572032:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1787430702.572040:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787430702.572136:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1787430702.572152:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1787430702.572328:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1787430702.572343:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:1.0:1787430702.572345:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787430702.572369:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1787430702.572377:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787430702.572393:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1787430702.572398:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:1.0:1787430702.572426:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1787430702.572434:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787430702.572444:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1787430702.572457:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1787430702.572594:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1787430702.573024:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:1.0:1787430702.573026:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787430702.573057:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1787430702.573064:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787430702.573079:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1787430702.573093:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:1.0:1787430702.573108:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1787430702.573114:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787430702.573127:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1787430702.573142:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1787430702.573941:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1787430702.573958:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:2.0:1787430702.573960:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1787430702.573975:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1787430702.573981:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787430702.573992:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1787430702.574003:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1787430702.574015:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1787430702.574020:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787430702.574029:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1787430702.574041:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1787430702.574054:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787430702.574056:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787430702.574060:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787430702.574115:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787430702.574118:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787430702.574714:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787430702.574731:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787430702.574743:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1787430702.574899:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1787430702.574920:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1787430702.574947:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1787430702.574958:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787430702.574960:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787430702.575243:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787430702.575258:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787430702.575269:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1787430702.575349:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1787430702.575383:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1787430702.575399:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1787430702.575408:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787430702.575409:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787430702.575717:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1787430702.575917:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1787430702.576015:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1787430702.576035:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1787430702.576059:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787430702.576062:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787430702.576291:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787430702.576315:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787430702.576324:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787430702.576421:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787430702.576441:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1787430702.576457:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1787430702.576466:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787430702.576468:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787430702.576701:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787430702.576716:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787430702.576727:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1787430702.576878:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1787430702.576895:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1787430702.576908:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:1.0:1787430702.576922:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787430702.576953:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.576971:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.576986:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.576993:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577000:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577633:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577641:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577647:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577655:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577694:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577710:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 21 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.577724:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729024:0@lo:104: 00000100:00100000:1.0:1787430702.577808:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430702.577866:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.577875:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 21 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.577885:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729152:0@lo:104: 00000100:00100000:2.0:1787430702.577894:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729024 00000100:00100000:2.0:1787430702.577903:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729024 00000100:00100000:1.0:1787430702.577908:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.577934:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729152 00000100:00100000:2.0:1787430702.577937:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729152 00010000:00010000:1.0:1787430702.577952:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.577954:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787430702.577966:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 21 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.577969:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6492:x1874256847729024:12345-0@lo:104: 00000100:00100000:1.0:1787430702.577983:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729280:0@lo:104: 00010000:00010000:2.0:1787430702.577986:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.578020:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430702.578056:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578064:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787430702.578066:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 21 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.578073:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6492:x1874256847729024:12345-0@lo:104: Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.578082:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729408:0@lo:104: 00000100:00100000:2.0:1787430702.578086:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787430702.578104:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729280 00000100:00100000:2.0:1787430702.578108:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729280 00000100:00100000:1.0:1787430702.578114:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.578122:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729408 00000100:00100000:2.0:1787430702.578126:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729408 00010000:00010000:1.0:1787430702.578138:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.578142:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787430702.578154:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 21 pid: 6491 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.578155:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6492:x1874256847729152:12345-0@lo:104: 00010000:00010000:2.0:1787430702.578164:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.578177:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729536:0@lo:104: 00010000:00010000:2.0:1787430702.578213:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787430702.578219:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6492:x1874256847729152:12345-0@lo:104: Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.578227:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.578232:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430702.578244:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729536 00000100:00100000:2.0:1787430702.578247:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729536 00010000:00010000:1.0:1787430702.578255:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.578263:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787430702.578269:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 21 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.578271:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6492:x1874256847729280:12345-0@lo:104: 00010000:00010000:2.0:1787430702.578284:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.578287:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729664:0@lo:104: 00010000:00010000:2.0:1787430702.578329:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787430702.578330:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.578338:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6492:x1874256847729280:12345-0@lo:104: Request processed in 67us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.578353:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787430702.578355:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.578376:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 21 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.578386:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729792:0@lo:104: 00000100:00100000:2.0:1787430702.578387:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787430702.578401:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729664 00000100:00100000:2.0:1787430702.578404:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729664 00000100:00100000:1.0:1787430702.578415:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.578421:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729792 00000100:00100000:2.0:1787430702.578425:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729792 00000100:00100000:1.0:1787430702.578429:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.578440:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430702.578448:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:6492:x1874256847729408:12345-0@lo:104: 00000100:00100000:1.0:1787430702.578453:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729024:0@lo:104: 00010000:00010000:2.0:1787430702.578456:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.578464:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729152:0@lo:104: 00000100:00100000:1.0:1787430702.578476:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729280:0@lo:104: 00000100:00100000:1.0:1787430702.578491:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729408:0@lo:104: 00010000:00010000:2.0:1787430702.578492:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787430702.578499:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:6492:x1874256847729408:12345-0@lo:104: Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.578506:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430702.578517:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430702.578522:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6492:x1874256847729536:12345-0@lo:104: 00010000:00010000:2.0:1787430702.578528:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578559:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787430702.578564:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:6492:x1874256847729536:12345-0@lo:104: Request processed in 42us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.578570:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430702.578581:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430702.578586:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6492:x1874256847729664:12345-0@lo:104: 00010000:00010000:2.0:1787430702.578591:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578640:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787430702.578645:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6492:x1874256847729664:12345-0@lo:104: Request processed in 59us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.578650:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430702.578671:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787430702.578677:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6492:x1874256847729792:12345-0@lo:104: 00010000:00010000:2.0:1787430702.578684:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578707:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787430702.578712:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6492:x1874256847729792:12345-0@lo:104: Request processed in 36us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.578717:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787430702.578732:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787430702.578738:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578745:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430702.578749:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578756:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430702.578764:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430702.578770:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430702.578814:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578830:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430702.578848:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578855:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b200/0x4dbb683ba6a93e11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578868:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787430702.578871:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578876:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430702.578879:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578887:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430702.578893:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430702.578898:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430702.578909:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578917:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430702.578923:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578940:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c00031600/0x4dbb683ba6a93de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93dee expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578949:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787430702.578952:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578958:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430702.578961:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578968:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430702.578975:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430702.578980:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430702.578993:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.578999:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787430702.579004:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729536:0@lo:104: 00010000:00010000:2.0:1787430702.579016:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.579017:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729664:0@lo:104: 00010000:00010000:2.0:1787430702.579030:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c00031400/0x4dbb683ba6a93dcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93dd2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.579033:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6492:1874256847729792:0@lo:104: 00010000:00010000:2.0:1787430702.579047:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787430702.579063:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579069:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8bc00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430702.579072:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579078:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430702.579083:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430702.579088:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430702.579101:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579106:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430702.579113:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579119:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93da8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.579123:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579128:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787430702.579133:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579147:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ae00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430702.579152:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579169:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430702.579176:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430702.579181:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430702.579192:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579198:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430702.579203:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579208:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ae00/0x4dbb683ba6a93d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d8c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579217:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430702.579220:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579225:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175c00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430702.579227:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579233:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430702.579239:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430702.579249:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430702.579261:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579267:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430702.579271:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579276:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d4d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579285:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430702.579288:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579294:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430702.579297:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579303:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430702.579309:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430702.579314:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430702.579325:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579330:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430702.579340:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579347:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a93d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d23 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579371:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430702.579373:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430702.579374:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430702.579387:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847729920:0@lo:103: 00000100:00100000:2.0:1787430702.579415:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.579450:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847730432:0@lo:103: 00000100:00100000:1.0:1787430702.579457:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847729920 00000100:00100000:1.0:1787430702.579463:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847729920 00000100:00100000:2.0:1787430702.579479:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430702.579493:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 22 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.579504:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787430702.579512:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847730048:0@lo:103: 00000100:00100000:1.0:1787430702.579521:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730432 00000100:00100000:1.0:1787430702.579526:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730432 00010000:00010000:1.0:1787430702.579540:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 23 pid: 6491 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.579547:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.579559:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730048 00000100:00100000:1.0:1787430702.579562:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730048 00010000:00010000:0.0:1787430702.579562:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430702.579567:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847730560:0@lo:103: 00010000:00010000:1.0:1787430702.579572:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 24 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.579586:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430702.579594:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847729920:12345-0@lo:103: 00000100:00100000:2.0:1787430702.579624:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430702.579641:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430702.579648:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 24 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.579655:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847730176:0@lo:103: 00010000:00010000:1.0:1787430702.579665:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 24 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.579677:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c00031a00/0x4dbb683ba6a93e18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93e11 expref: 24 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.579686:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430702.579688:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430702.579702:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847730688:0@lo:103: 00000100:00100000:0.0:1787430702.579722:0:6481:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787430702.579732:0:6481:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787430702.579741:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.579742:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3629:x1874256847729920:12345-0@lo:103: Request processed in 145us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.579760:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430702.579760:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787430702.579770:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847730304:0@lo:103: 00000100:00100000:1.0:1787430702.579775:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730560 00000100:00100000:3.0:1787430702.579777:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847729920:0@lo:103: 00000100:00100000:1.0:1787430702.579779:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730560 00010000:00010000:1.0:1787430702.579800:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 23 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.579814:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.579826:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730176 00000100:00100000:1.0:1787430702.579831:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730176 00010000:00010000:1.0:1787430702.579846:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 24 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.579849:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730688 00000100:00100000:2.0:1787430702.579855:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730688 00000100:00100000:1.0:1787430702.579863:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730304 00000100:00100000:1.0:1787430702.579868:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730304 00010000:00010000:2.0:1787430702.579880:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 26 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.579883:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 26 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.579909:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787430702.579916:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430702.579921:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+26:3629:x1874256847730432:12345-0@lo:103: 00000100:00100000:1.0:1787430702.579929:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+26:3629:x1874256847730048:12345-0@lo:103: 00010000:00010000:2.0:1787430702.579931:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430702.579939:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 26 pid: 6491 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.579941:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430702.579950:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 26 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579953:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 26 pid: 6491 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.579973:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 26 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.579991:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013ebc00/0x4dbb683ba6a93d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93d85 expref: 26 pid: 6491 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.579995:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013eaa00/0x4dbb683ba6a93dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93de7 expref: 26 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.580007:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430702.580010:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430702.580066:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847730432:12345-0@lo:103: Request processed in 148us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.580071:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847730048:12345-0@lo:103: Request processed in 143us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.580075:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847730048:0@lo:103: 00000100:00100000:2.0:1787430702.580077:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787430702.580089:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430702.580100:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430702.580111:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847730432:0@lo:103: 00000100:00100000:2.0:1787430702.580112:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11440850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3629:x1874256847730560:12345-0@lo:103: 00000100:00100000:1.0:1787430702.580118:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787430702.580124:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430702.580131:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 22 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.580133:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787430702.580133:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3627:x1874256847730176:12345-0@lo:103: 00010000:00010000:2.0:1787430702.580149:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 22 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.580152:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3627:x1874256847730688:12345-0@lo:103: 00010000:00010000:1.0:1787430702.580154:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430702.580165:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 22 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.580166:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93d46 expref: 22 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.580185:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 22 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.580205:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430702.580205:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c00030c00/0x4dbb683ba6a93dd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93dcb expref: 21 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.580218:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430702.580246:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11440850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3629:x1874256847730560:12345-0@lo:103: Request processed in 138us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.580253:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787430702.580260:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3627:x1874256847730176:12345-0@lo:103: Request processed in 132us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.580268:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430702.580289:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847730560:0@lo:103: 00000100:00100000:1.0:1787430702.580290:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787430702.580303:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:3627:x1874256847730304:12345-0@lo:103: 00010000:00010000:1.0:1787430702.580311:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430702.580317:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 18 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.580326:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 18 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.580334:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013eb400/0x4dbb683ba6a93da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93da1 expref: 18 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.580348:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430702.580367:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430702.580375:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 17 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.580384:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:3627:x1874256847730304:12345-0@lo:103: Request processed in 83us (573us total) trans 0 rc 0/0 00010000:00010000:3.0:1787430702.580391:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 17 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.580394:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787430702.580410:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c00030600/0x4dbb683ba6a93d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93d1c expref: 16 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580424:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.580427:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847730304:0@lo:103: 00000100:00100000:1.0:1787430702.580437:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847730176:0@lo:103: 00010000:00010000:3.0:1787430702.580439:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580455:0:9495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580462:0:9495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580469:0:9495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580476:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580482:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430702.580492:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580501:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580527:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.580538:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430702.580559:0:6492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.580578:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.580579:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:3627:x1874256847730688:12345-0@lo:103: Request processed in 433us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430702.580595:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787430702.580595:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a93e2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787430702.580656:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787430702.580970:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847730688:0@lo:103: 00000100:00100000:1.0:1787430702.582502:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:9484:x1874256847728896:12345-0@lo:253: Request processed in 11387us (11576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.582512:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787430702.582636:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847728896:0@lo:253: 10000000:01000000:3.0:1787430702.582653:0:9484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787430702.582656:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787430702.582658:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430702.582660:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430702.582661:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787430702.582663:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430702.582664:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430702.582666:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430702.582667:0:9484:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787430702.582669:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430702.582670:0:9484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787430702.582690:0:9484:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2c363a8000 from lustre-OST0001 10000000:01000000:3.0:1787430702.582716:0:9484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787430702.582719:0:9484:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787430702.582727:0:9484:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e2c10964d28 local copy 10000000:01000000:3.0:1787430702.582730:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787430702.582759:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.582792:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.582801:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.582817:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847730816:0@lo:101: 00000100:00100000:3.0:1787430702.582849:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.582881:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.582901:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730816 00000100:00100000:2.0:1787430702.582908:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730816 00000100:00100000:2.0:1787430702.582949:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787430702.582959:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+14:9484:x1874256847730816:12345-0@lo:101: 00010000:00010000:2.0:1787430702.582972:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430702.582986:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42174c00/0x4dbb683ba6a93e3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93e34 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.583007:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42174c00/0x4dbb683ba6a93e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e34 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.583016:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42174c00/0x4dbb683ba6a93e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e34 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.583025:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174c00, rc 0) 00000100:00100000:2.0:1787430702.583065:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847730816:12345-0@lo:101: Request processed in 108us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.583072:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787430702.583092:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847730816:0@lo:101: 00010000:00010000:3.0:1787430702.583107:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.583184:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.583276:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847730944:0@lo:501: 00000100:00100000:3.0:1787430702.583302:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.583325:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430702.583341:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847730944 00000100:00100000:1.0:1787430702.583346:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847730944 00000100:00100000:1.0:1787430702.583395:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787430702.583402:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847730944:12345-0@lo:501: 00000100:00100000:1.0:1787430702.583480:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847730944:12345-0@lo:501: Request processed in 79us (177us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430702.583487:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787430702.583867:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847730944:0@lo:501: 10000000:01000000:3.0:1787430702.583880:0:9484:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787430702.583897:0:9484:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787430702.583901:0:9484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.583909:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.583930:0:9484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.583946:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787430702.583973:0:9484:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2c363a8000 10000000:01000000:3.0:1787430702.583978:0:9484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787430702.583984:0:9484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787430702.583987:0:9484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430702.583991:0:9484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787430702.583994:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787430702.584010:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.584017:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.584025:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.584036:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731072:0@lo:101: 00000100:00100000:3.0:1787430702.584064:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.584088:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.584132:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731072 00000100:00100000:2.0:1787430702.584136:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731072 00000100:00100000:2.0:1787430702.584160:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787430702.584164:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731072:12345-0@lo:101: 00010000:00010000:2.0:1787430702.584175:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430702.584182:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93e42 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.584194:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.584200:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.584205:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174800, rc 0) 00000100:00100000:2.0:1787430702.584233:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847731072:12345-0@lo:101: Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.584237:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:0.0:1787430702.584408:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430702.584416:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.584423:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ba00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430702.584427:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.584434:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430702.584441:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430702.584447:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430702.584466:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.584477:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430702.584502:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.584509:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a93e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4dbb683ba6a93e3b expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.584520:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430702.584522:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430702.584529:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430702.584576:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430702.584589:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847731200:0@lo:103: 00000100:00100000:1.0:1787430702.584646:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430702.584681:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731200 00000100:00100000:0.0:1787430702.584687:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731200 00000100:00100000:0.0:1787430702.584726:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430702.584734:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:3627:x1874256847731200:12345-0@lo:103: 00010000:00010000:0.0:1787430702.584742:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430702.584753:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42174c00/0x4dbb683ba6a93e3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93e34 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.584763:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430702.584790:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:3627:x1874256847731200:12345-0@lo:103: Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.584796:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430702.584875:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731072:0@lo:101: 00010000:00010000:3.0:1787430702.584887:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.584895:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.584974:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847731200:0@lo:103: 00000100:00100000:3.0:1787430702.585010:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731328:0@lo:501: 00000100:00100000:3.0:1787430702.585034:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.585054:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.585160:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731328 00000100:00100000:0.0:1787430702.585164:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731328 00000100:00100000:0.0:1787430702.585196:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787430702.585203:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731328:12345-0@lo:501: 00000100:00100000:0.0:1787430702.585313:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731328:12345-0@lo:501: Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.585320:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787430702.585387:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731328:0@lo:501: 00000100:00100000:1.0:1787430702.585413:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731456:0@lo:503: 00000100:00100000:1.0:1787430702.586211:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.586244:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.586252:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731456 00000100:00100000:0.0:1787430702.586319:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731456 00000100:00100000:0.0:1787430702.586433:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787430702.586441:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731456:12345-0@lo:503: 00000100:00100000:0.0:1787430702.586580:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731456:12345-0@lo:503: Request processed in 139us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.586587:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787430702.586756:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731456:0@lo:503: 00000040:00080000:3.0:1787430702.587235:0:9484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787430702.587431:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731584:0@lo:502: 00000100:00100000:3.0:1787430702.587469:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.587494:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.587744:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731584 00000100:00100000:2.0:1787430702.587749:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731584 00000100:00100000:2.0:1787430702.587818:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787430702.587827:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731584:12345-0@lo:502: 00000100:00100000:2.0:1787430702.587933:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731584:12345-0@lo:502: Request processed in 106us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.587941:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787430702.588003:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731584:0@lo:502: 00000040:00080000:3.0:1787430702.588339:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787430702.588442:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787430702.588456:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787430702.588470:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787430702.588482:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787430702.588493:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787430702.588513:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731712:0@lo:502: 00000100:00100000:3.0:1787430702.588547:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.588625:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89780 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.589183:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731712 00000100:00100000:0.0:1787430702.589196:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731712 00000100:00100000:0.0:1787430702.589232:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787430702.589241:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731712:12345-0@lo:502: 00000100:00100000:0.0:1787430702.589563:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731712:12345-0@lo:502: Request processed in 323us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.589571:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787430702.589743:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731712:0@lo:502: 00000040:00080000:1.0:1787430702.589907:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787430702.589917:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1787430702.590559:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787430702.590566:0:9496:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787430702.590573:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430702.590575:0:9496:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787430702.590580:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430702.590625:0:9496:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e2b036299b8) 00000020:00000080:3.0:1787430702.590648:0:9496:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787430702.590654:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787430702.590721:0:9496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c363a8000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787430702.590731:0:9496:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787430702.590737:0:9496:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4dbb683ba6a93e57 00010000:00010000:3.0:1787430702.596477:0:9496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1787430702.596794:0:9496:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787430702.599092:0:9496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787430702.599475:0:9496:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787430702.603198:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787430702.603865:0:9496:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787430702.612092:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787430702.613257:0:9496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787430702.613267:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430702.613273:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430702.613275:0:9496:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787430702.613278:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430702.613282:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430702.613283:0:9496:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787430702.613287:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787430702.613288:0:9496:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787430702.613306:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430702.613309:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430702.613310:0:9496:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787430702.613313:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787430702.613511:0:9484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787430702.613538:0:9484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787430702.613561:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.613572:0:9484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430702.613579:0:9484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c363a8000 from 1 10000000:01000000:3.0:1787430702.613582:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430702.613639:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.613646:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.613658:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.613680:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731840:0@lo:101: 00000100:00100000:3.0:1787430702.613746:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.613798:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.613860:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731840 00000100:00100000:2.0:1787430702.613867:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731840 00000100:00100000:2.0:1787430702.613918:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787430702.613929:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:9484:x1874256847731840:12345-0@lo:101: 00010000:00010000:2.0:1787430702.613942:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430702.613954:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93e5e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.613989:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.614000:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.614009:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175600, rc 0) 00000100:00100000:2.0:1787430702.614050:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847731840:12345-0@lo:101: Request processed in 124us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.614057:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787430702.616426:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731840:0@lo:101: 00010000:00010000:2.0:1787430702.616451:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.616463:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430702.616569:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731968:0@lo:501: 00000100:00100000:2.0:1787430702.616645:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.616677:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02d97e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.616735:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847731968 00000100:00100000:0.0:1787430702.616740:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847731968 00000100:00100000:0.0:1787430702.616784:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787430702.616793:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847731968:12345-0@lo:501: 00000100:00100000:0.0:1787430702.616896:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847731968:12345-0@lo:501: Request processed in 103us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.616903:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787430702.616940:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847731968:0@lo:501: 00000100:00100000:0.0:1787430702.616968:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732096:0@lo:503: 00000100:00100000:0.0:1787430702.617006:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430702.617027:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03b5c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.619250:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732096 00000100:00100000:2.0:1787430702.619261:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732096 00000100:00100000:2.0:1787430702.619311:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787430702.619321:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847732096:12345-0@lo:503: 00000100:00100000:2.0:1787430702.619479:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847732096:12345-0@lo:503: Request processed in 159us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.619486:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787430702.619646:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732096:0@lo:503: 00000040:00080000:0.0:1787430702.619882:0:9484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430702.619953:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732224:0@lo:502: 00000100:00100000:0.0:1787430702.619992:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430702.620014:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03b5c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.620031:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732224 00000100:00100000:0.0:1787430702.620035:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732224 00000100:00100000:0.0:1787430702.620054:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787430702.620060:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847732224:12345-0@lo:502: 00000100:00100000:0.0:1787430702.620131:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847732224:12345-0@lo:502: Request processed in 70us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.620138:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787430702.620176:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732224:0@lo:502: 00000040:00080000:0.0:1787430702.620381:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787430702.620405:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787430702.620424:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732352:0@lo:502: 00000100:00100000:0.0:1787430702.620453:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430702.620466:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03b5c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.620478:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732352 00000100:00100000:0.0:1787430702.620481:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732352 00000100:00100000:0.0:1787430702.620499:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787430702.620505:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847732352:12345-0@lo:502: 00000100:00100000:0.0:1787430702.620574:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847732352:12345-0@lo:502: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.620580:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787430702.620631:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732352:0@lo:502: 00000040:00080000:0.0:1787430702.620669:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787430702.620676:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787430702.623813:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430702.623824:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430702.623827:0:9500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787430702.623833:0:9500:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c363a8000 00000020:00000080:2.0:1787430702.623836:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787430702.623845:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430702.623848:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430702.623849:0:9500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787430702.623852:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787430702.624580:0:9484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787430702.624807:0:9484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430702.624832:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.624846:0:9484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430702.624898:0:9484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787430702.624901:0:9484:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2c363a8000 10000000:01000000:0.0:1787430702.624905:0:9484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2c363a8000 10000000:01000000:0.0:1787430702.624909:0:9484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430702.624914:0:9484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c363a8000 from 1 10000000:01000000:0.0:1787430702.624917:0:9484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430702.624950:0:9484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.624959:0:9484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.624970:0:9484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430702.624993:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732480:0@lo:101: 00000100:00100000:0.0:1787430702.625059:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430702.625106:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c03b5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.625540:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732480 00000100:00100000:2.0:1787430702.625547:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732480 00000100:00100000:2.0:1787430702.625590:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787430702.625620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9484:x1874256847732480:12345-0@lo:101: 00010000:00010000:2.0:1787430702.625633:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430702.625647:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93e6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.625669:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.625679:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430702.625688:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174600, rc 0) 00000100:00100000:2.0:1787430702.625734:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732480:12345-0@lo:101: Request processed in 136us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.625740:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787430702.625839:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732480:0@lo:101: 00010000:00010000:1.0:1787430702.625853:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.625862:0:9484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430702.625941:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732608:0@lo:501: 00000100:00100000:1.0:1787430702.625966:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.625993:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.626448:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732608 00000100:00100000:2.0:1787430702.626453:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732608 00000100:00100000:2.0:1787430702.626482:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787430702.626489:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732608:12345-0@lo:501: 00000100:00100000:2.0:1787430702.626626:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732608:12345-0@lo:501: Request processed in 138us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.626633:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787430702.626714:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732608:0@lo:501: 00000100:00100000:1.0:1787430702.626742:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732736:0@lo:503: 00000100:00100000:1.0:1787430702.626781:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.626806:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.627039:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732736 00000100:00100000:2.0:1787430702.627044:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732736 00000100:00100000:2.0:1787430702.627067:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787430702.627073:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732736:12345-0@lo:503: 00000100:00100000:2.0:1787430702.627156:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732736:12345-0@lo:503: Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.627163:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787430702.627685:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732736:0@lo:503: 00000040:00080000:1.0:1787430702.627909:0:9484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430702.627969:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732864:0@lo:502: 00000100:00100000:1.0:1787430702.628006:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.628032:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430702.628110:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732864 00000100:00100000:2.0:1787430702.628114:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732864 00000100:00100000:2.0:1787430702.628153:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787430702.628161:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732864:12345-0@lo:502: 00000100:00100000:2.0:1787430702.628242:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732864:12345-0@lo:502: Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.628248:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787430702.628343:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732864:0@lo:502: 00000040:00080000:1.0:1787430702.628870:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787430702.628896:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787430702.628910:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787430702.628921:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787430702.628933:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787430702.628945:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787430702.628956:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787430702.628967:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787430702.628978:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787430702.628990:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787430702.629002:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787430702.629013:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787430702.629024:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787430702.629035:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787430702.629047:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787430702.629058:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787430702.629070:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787430702.629081:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787430702.629091:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787430702.629100:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787430702.629111:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787430702.629120:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787430702.629130:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787430702.629140:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787430702.629159:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787430702.629169:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787430702.629178:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787430702.629188:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787430702.629198:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787430702.629208:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787430702.629217:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787430702.629228:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787430702.629239:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787430702.629250:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787430702.629260:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787430702.629269:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787430702.629279:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1787430702.629288:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787430702.629299:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1787430702.629310:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1787430702.629320:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1787430702.629333:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1787430702.629344:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1787430702.629440:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1787430702.629514:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1787430702.629531:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1787430702.629558:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732992:0@lo:502: 00000100:00100000:1.0:1787430702.629781:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.629849:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.629888:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847732992 00000100:00100000:0.0:1787430702.629895:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847732992 00000100:00100000:0.0:1787430702.629947:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787430702.629955:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732992:12345-0@lo:502: 00000100:00100000:0.0:1787430702.630126:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847732992:12345-0@lo:502: Request processed in 171us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.630133:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787430702.630198:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847732992:0@lo:502: 00000040:00080000:1.0:1787430702.630238:0:9484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1787430702.630246:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1787430702.630905:0:9501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787430702.630931:0:9501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e2b03558000) 00000020:00000080:2.0:1787430702.630955:0:9501:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1787430702.631040:0:9501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c363a8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787430702.631044:0:9501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c363a8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787430702.631047:0:9501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c363a8000 3 00010000:00080000:2.0:1787430702.631073:0:9501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b03894000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430702.633717:0:9501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1787430702.633966:0:9501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787430702.634006:0:9501:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787430702.634022:0:9501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4dbb683ba6a93e81 00000100:00080000:2.0:1787430702.634032:0:9501:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430702.634037:0:9501:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2b03894000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430702.634070:0:9501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c315adc00 x1874256847733120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430702.634099:0:9501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787430702.634266:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847733504:0@lo:400: 00000100:00100000:1.0:1787430702.634325:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.634380:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847734016:0@lo:400: 00000100:00100000:1.0:1787430702.634406:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.634429:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787430702.634435:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847733632:0@lo:400: 00000100:00100000:1.0:1787430702.634456:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.634473:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847734144:0@lo:400: 00000100:00100000:1.0:1787430702.634493:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.634521:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847733504 00000100:00100000:1.0:1787430702.634526:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847733504 00000100:00100000:1.0:1787430702.634564:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787430702.634574:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847733504:12345-0@lo:400: 00000100:00100000:1.0:1787430702.634643:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847733504:12345-0@lo:400: Request processed in 71us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.634650:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787430702.634670:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734016 00000100:00100000:1.0:1787430702.634673:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734016 00000100:00100000:1.0:1787430702.634700:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734144 00000100:00100000:1.0:1787430702.634703:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734144 00000100:00100000:1.0:1787430702.634721:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430702.634727:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847734016:12345-0@lo:400: 00000100:00100000:1.0:1787430702.634754:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847734016:12345-0@lo:400: Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.634760:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430702.634771:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430702.634777:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847734144:12345-0@lo:400: 00000100:00100000:1.0:1787430702.634799:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847734144:12345-0@lo:400: Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.634815:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430702.634833:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847733632 00000100:00100000:1.0:1787430702.634836:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847733632 00000100:00100000:1.0:1787430702.634859:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787430702.634865:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847733632:12345-0@lo:400: 00000100:00100000:1.0:1787430702.634894:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847733632:12345-0@lo:400: Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.634899:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787430702.634917:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430702.634948:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847733632:0@lo:400: 00010000:00080000:1.0:1787430702.634958:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03578a80 x1874256847734144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430702.634968:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847734144:0@lo:400: 00010000:00080000:1.0:1787430702.634977:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b0357b800 x1874256847733504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430702.634985:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847733504:0@lo:400: 00010000:00080000:1.0:1787430702.634993:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b0357a300 x1874256847734016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430702.635000:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847734016:0@lo:400: 00000100:00100000:2.0:1787430702.635155:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847733248:0@lo:400: 00000100:00100000:2.0:1787430702.635181:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.635207:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847733760:0@lo:400: 00000100:00100000:2.0:1787430702.635225:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.635242:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787430702.635248:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847733376:0@lo:400: 00000100:00100000:2.0:1787430702.635267:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.635282:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847733888:0@lo:400: 00000100:00100000:2.0:1787430702.635302:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.635325:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847733248 00000100:00100000:2.0:1787430702.635329:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847733248 00000100:00100000:2.0:1787430702.635355:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847733760 00000100:00100000:2.0:1787430702.635365:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847733760 00000100:00100000:2.0:1787430702.635384:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847733888 00000100:00100000:2.0:1787430702.635386:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847733888 00000100:00100000:2.0:1787430702.635423:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430702.635430:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847733248:12345-0@lo:400: 00000100:00100000:2.0:1787430702.635464:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847733248:12345-0@lo:400: Request processed in 34us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.635470:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430702.635483:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430702.635494:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847733760:12345-0@lo:400: 00000100:00100000:2.0:1787430702.635520:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847733760:12345-0@lo:400: Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.635526:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430702.635539:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430702.635545:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847733888:12345-0@lo:400: 00000100:00100000:2.0:1787430702.635570:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847733888:12345-0@lo:400: Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.635575:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430702.635593:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847733376 00000100:00100000:2.0:1787430702.635596:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847733376 00000100:00100000:2.0:1787430702.635638:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787430702.635645:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847733376:12345-0@lo:400: 00000100:00100000:2.0:1787430702.635673:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847733376:12345-0@lo:400: Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.635678:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787430702.635703:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847733376:0@lo:400: 00010000:00080000:2.0:1787430702.635712:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b0357a680 x1874256847733888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430702.635721:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847733888:0@lo:400: 00010000:00080000:2.0:1787430702.635729:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b0357ad80 x1874256847733248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430702.635736:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847733248:0@lo:400: 00010000:00080000:2.0:1787430702.635744:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03579f80 x1874256847733760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430702.635763:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847733760:0@lo:400: 00000100:00080000:1.0:1787430702.635873:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430702.635876:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430702.635956:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847733120:0@lo:38: 00000100:00100000:3.0:1787430702.635988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.636214:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847733120 00000100:00100000:2.0:1787430702.636219:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847733120 00000100:00100000:2.0:1787430702.636246:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787430702.636251:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847733120:12345-0@lo:38: 00010000:00080000:2.0:1787430702.636271:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1787430702.636300:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4dbb683ba6a93e88 00000004:00100000:2.0:1787430702.636315:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787430702.636345:0:6499:0:(import.c:65:import_set_state_nolock()) ffff8e2b03890800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430702.636461:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874256847733120:12345-0@lo:38: Request processed in 208us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.636468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1787430702.636571:0:9501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787430702.636586:0:9501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8e2b0355cd28) 00000020:00000080:2.0:1787430702.636691:0:9501:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1787430702.636787:0:9501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c363a8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787430702.636792:0:9501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c363a8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787430702.636795:0:9501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c363a8000 3 00010000:00080000:2.0:1787430702.636819:0:9501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b03890000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.125@tcp at head 00010000:00080000:3.0:1787430702.637472:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c315adc00 x1874256847733120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430702.637482:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430702.637489:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787430702.637496:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787430702.637499:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787430702.637501:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787430702.637507:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847733120:0@lo:38: 00000100:00100000:3.0:1787430702.639826:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9502:1874256847734272:0@lo:901: 00000100:00100000:3.0:1787430702.639883:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.639921:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116566c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430702.639985:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734272 00000100:00100000:1.0:1787430702.639992:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734272 00000100:00100000:1.0:1787430702.640051:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430702.640060:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9502:x1874256847734272:12345-0@lo:901: 00000100:00100000:1.0:1787430702.640155:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9502:x1874256847734272:12345-0@lo:901: Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.640162:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787430702.640203:0:9502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b034f8e00 x1874256847734272/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787430718 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430702.640215:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9502:1874256847734272:0@lo:901: 00000100:00080000:3.0:1787430702.640443:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787430702.641890:0:9501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1787430702.642066:0:9501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787430702.642118:0:9501:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787430702.642130:0:9501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4dbb683ba6a93e96 00000100:00080000:2.0:1787430702.642139:0:9501:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430702.642144:0:9501:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e2b03890000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430702.642169:0:9501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c3a638e00 x1874256847734400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430702.642200:0:9501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787430702.642459:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1874256847734400:0@lo:38: 00000100:00100000:3.0:1787430702.642511:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.642536:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734400 00000100:00100000:1.0:1787430702.642541:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734400 00000100:00100000:1.0:1787430702.642568:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430702.642580:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1874256847734400:12345-0@lo:38: 00010000:00080000:1.0:1787430702.642618:0:8819:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1787430702.642647:0:8819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4dbb683ba6a93e9d 00000004:00100000:1.0:1787430702.642661:0:8819:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787430702.642690:0:8819:0:(import.c:65:import_set_state_nolock()) ffff8e2b034c3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430702.642734:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874256847734400:12345-0@lo:38: Request processed in 159us (222us total) trans 0 rc 0/0 00000040:00080000:2.0:1787430702.642917:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00010000:00080000:0.0:1787430702.645019:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c3a638e00 x1874256847734400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430702.645031:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430702.645038:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787430702.645045:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787430702.645049:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787430702.645053:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03890000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787430702.645059:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1874256847734400:0@lo:38: 00000100:00100000:1.0:1787430702.645836:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:1.0:1787430702.645879:0:9484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1787430702.645912:0:9484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430702.645938:0:9484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.645949:0:9484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787430702.646002:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787430702.646004:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787430702.646008:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430702.646010:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430702.646011:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430702.646013:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430702.646014:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430702.646016:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430702.646017:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430702.646018:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430702.646020:0:9484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430702.646024:0:9484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787430702.646026:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430702.646027:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787430702.646028:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430702.646029:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430702.646030:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430702.646031:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430702.646032:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430702.646033:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430702.646034:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430702.646035:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430702.646036:0:9484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430702.646054:0:9484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787430702.646069:0:9484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847734528:0@lo:253: 00000100:00100000:1.0:1787430702.646130:0:9484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430702.646163:0:9484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430702.646181:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734528 00000100:00100000:1.0:1787430702.646187:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734528 00000100:00100000:1.0:1787430702.646225:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787430702.646233:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847734528:12345-0@lo:253: 20000000:01000000:1.0:1787430702.646256:0:6491:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787430702.646270:0:6491:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787430702.654009:0:6491:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787430702.654026:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787430702.654155:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787430702.654160:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787430702.654180:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.654200:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.654208:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.654226:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.654258:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.654270:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 17 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.654284:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847734656:0@lo:104: 00000100:00100000:3.0:1787430702.654321:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430702.654338:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9484:x1874256847734528:12345-0@lo:253: Request processed in 8104us (8207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.654347:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787430702.654433:0:9484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9484:1874256847734528:0@lo:253: 00000100:00100000:0.0:1787430702.654438:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734656 00000100:00100000:0.0:1787430702.654444:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734656 10000000:01000000:1.0:1787430702.654445:0:9484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787430702.654448:0:9484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430702.654450:0:9484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787430702.654456:0:9484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430702.654458:0:9484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430702.654459:0:9484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430702.654460:0:9484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430702.654461:0:9484:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430702.654463:0:9484:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430702.654464:0:9484:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430702.654466:0:9484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430702.654467:0:9484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787430702.654481:0:9484:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787430702.654529:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.654537:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 16 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.654546:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847734784:0@lo:104: 00000100:00100000:3.0:1787430702.654569:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430702.654674:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430702.654753:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734784 00000100:00100000:0.0:1787430702.654757:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734784 00000100:00100000:0.0:1787430702.654778:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430702.654787:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6513:x1874256847734656:12345-0@lo:104: 00010000:00010000:0.0:1787430702.654799:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.654848:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430702.654854:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:6513:x1874256847734656:12345-0@lo:104: Request processed in 69us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.654861:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430702.654874:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430702.654887:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847734784:12345-0@lo:104: 00010000:00010000:0.0:1787430702.654895:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.654926:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787430702.654931:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:6513:x1874256847734784:12345-0@lo:104: Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.654936:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787430702.654953:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430702.654960:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.654967:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430702.654971:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.654979:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430702.654986:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430702.654992:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430702.655016:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655022:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430702.655040:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655058:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c00031800/0x4dbb683ba6a93dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93de0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655069:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430702.655073:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655079:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430702.655082:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655089:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430702.655096:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430702.655101:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430702.655114:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655120:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430702.655126:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655133:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a93d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d9a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655144:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430702.655151:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430702.655152:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430702.655158:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430702.655169:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847734912:0@lo:103: 00000100:00100000:0.0:1787430702.655196:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430702.655221:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430702.655227:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847735040:0@lo:103: 00000100:00100000:0.0:1787430702.655247:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430702.655271:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847734912 00000100:00100000:0.0:1787430702.655275:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847734912 00010000:00010000:0.0:1787430702.655291:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 17 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430702.655310:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735040 00000100:00100000:0.0:1787430702.655313:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735040 00010000:00010000:0.0:1787430702.655323:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 18 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430702.655341:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430702.655417:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:3629:x1874256847734912:12345-0@lo:103: 00010000:00010000:0.0:1787430702.655430:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430702.655435:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 18 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655446:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 18 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655460:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430702.655488:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:3629:x1874256847734912:12345-0@lo:103: Request processed in 141us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.655502:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430702.655516:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430702.655523:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:3629:x1874256847735040:12345-0@lo:103: 00010000:00010000:0.0:1787430702.655531:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430702.655535:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 17 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655544:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 17 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655557:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655565:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430702.655577:0:9495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006844641s 00010000:00010000:0.0:1787430702.655582:0:9495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655589:0:9495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655596:0:9495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655628:0:9495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655634:0:9495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430702.655644:0:9495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655652:0:9495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655661:0:9495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430702.655671:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430702.655693:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:3629:x1874256847735040:12345-0@lo:103: Request processed in 171us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.655700:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430702.655728:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847735040:0@lo:103: 00000100:00100000:0.0:1787430702.655736:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847734912:0@lo:103: 00010000:00010000:3.0:1787430702.655814:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013ea200/0x4dbb683ba6a93de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93dd9 expref: 16 pid: 6492 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.655824:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847734656:0@lo:104: 00010000:00010000:3.0:1787430702.655833:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013eb000/0x4dbb683ba6a93d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93d93 expref: 15 pid: 6489 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430702.655842:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1874256847734784:0@lo:104: 00010000:00010000:3.0:1787430702.655861:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.655869:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.655875:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430702.655881:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a93ea4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787430702.658229:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787430702.658403:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787430702.658535:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787430702.658667:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787430702.658816:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787430702.658922:0:9484:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787430702.660162:0:9484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787430702.673520:0:9484:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787430702.673529:0:9484:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787430702.673561:0:9484:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787430702.673596:0:9484:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787430702.674299:0:9484:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787430702.674323:0:9484:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787430702.674976:0:9484:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430702.675161:0:9484:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:3.0:1787430703.039861:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787430703.039868:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c35f42000 from 39 10000000:01000000:3.0:1787430703.039874:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787430703.039917:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.039930:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.040053:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430703.040077:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735168:0@lo:101: 00000100:00100000:3.0:1787430703.040157:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.040206:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735168 00000100:00100000:0.0:1787430703.040213:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735168 00000100:00100000:3.0:1787430703.040220:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89780 going to sleep for 11 seconds 00000100:00100000:0.0:1787430703.040267:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787430703.040277:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847735168:12345-0@lo:101: 00010000:00010000:0.0:1787430703.040291:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430703.040303:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93eab expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430703.040324:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430703.040335:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430703.040365:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1de00, rc 0) 00000100:00100000:0.0:1787430703.040410:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847735168:12345-0@lo:101: Request processed in 134us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.040416:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787430703.040447:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735168:0@lo:101: 00010000:00010000:3.0:1787430703.040526:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.040545:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430703.040615:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735296:0@lo:501: 00000100:00100000:3.0:1787430703.042434:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.042793:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89780 going to sleep for 11 seconds 00000100:00100000:0.0:1787430703.042955:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735296 00000100:00100000:0.0:1787430703.042962:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735296 00000100:00100000:0.0:1787430703.043036:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787430703.043046:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847735296:12345-0@lo:501: 00000100:00100000:0.0:1787430703.043183:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847735296:12345-0@lo:501: Request processed in 138us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.043191:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787430703.043253:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735296:0@lo:501: 00000100:00100000:2.0:1787430703.043294:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735424:0@lo:503: 00000100:00100000:2.0:1787430703.043335:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.044245:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b94480 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.044312:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735424 00000100:00100000:1.0:1787430703.044318:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735424 00000100:00100000:1.0:1787430703.044347:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787430703.044366:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847735424:12345-0@lo:503: 00000100:00100000:1.0:1787430703.044472:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847735424:12345-0@lo:503: Request processed in 118us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.044479:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787430703.044527:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735424:0@lo:503: 00000100:00100000:1.0:1787430703.044737:0:9539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9539:1874256847735552:0@lo:502: 00000100:00100000:1.0:1787430703.044777:0:9539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.044795:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735552 00000100:00100000:1.0:1787430703.044799:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735552 00000100:00100000:1.0:1787430703.044815:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787430703.044819:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9539:x1874256847735552:12345-0@lo:502: 00000100:00100000:1.0:1787430703.044885:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9539:x1874256847735552:12345-0@lo:502: Request processed in 64us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.044892:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787430703.044924:0:9539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.044936:0:9539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9539:1874256847735552:0@lo:502: 00000100:00100000:1.0:1787430703.044973:0:9539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9539:1874256847735680:0@lo:502: 00000100:00100000:1.0:1787430703.045002:0:9539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.045020:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735680 00000100:00100000:1.0:1787430703.045023:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735680 00000100:00100000:1.0:1787430703.045037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787430703.045042:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9539:x1874256847735680:12345-0@lo:502: 00000100:00100000:1.0:1787430703.045094:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:9539:x1874256847735680:12345-0@lo:502: Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.045101:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787430703.045126:0:9539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.045136:0:9539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9539:1874256847735680:0@lo:502: 00000040:00080000:1.0:1787430703.045151:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787430703.045199:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787430703.045217:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430703.045226:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.045247:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430703.045257:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787430703.045259:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787430703.045262:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787430703.045283:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.045291:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.045300:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430703.045311:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735808:0@lo:101: 00000100:00100000:1.0:1787430703.045335:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.045347:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.045371:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735808 00000100:00100000:1.0:1787430703.045374:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735808 00000100:00100000:1.0:1787430703.045390:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787430703.045396:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847735808:12345-0@lo:101: 00010000:00010000:1.0:1787430703.045404:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430703.045415:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93eb9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.045434:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.045454:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.045462:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360efe00, rc 0) 00000100:00100000:1.0:1787430703.045489:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847735808:12345-0@lo:101: Request processed in 93us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.045495:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787430703.045522:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735808:0@lo:101: 00010000:00010000:1.0:1787430703.045534:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.045542:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430703.045578:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735936:0@lo:501: 00000100:00100000:1.0:1787430703.045620:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.045638:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.045649:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847735936 00000100:00100000:1.0:1787430703.045652:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847735936 00000100:00100000:1.0:1787430703.045668:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787430703.045673:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847735936:12345-0@lo:501: 00000100:00100000:1.0:1787430703.045753:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847735936:12345-0@lo:501: Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.045759:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787430703.045785:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847735936:0@lo:501: 00000100:00100000:1.0:1787430703.045807:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736064:0@lo:503: 00000100:00100000:1.0:1787430703.045842:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.045853:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.045862:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736064 00000100:00100000:1.0:1787430703.045865:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736064 00000100:00100000:1.0:1787430703.045879:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787430703.045884:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847736064:12345-0@lo:503: 00000100:00100000:1.0:1787430703.045944:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847736064:12345-0@lo:503: Request processed in 59us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.045950:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787430703.045983:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736064:0@lo:503: 00000100:00100000:0.0:1787430703.046528:0:9540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9540:1874256847736192:0@lo:502: 00000100:00100000:0.0:1787430703.046566:0:9540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.046805:0:9540:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c079473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.049914:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736192 00000100:00100000:1.0:1787430703.049927:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736192 00000100:00100000:1.0:1787430703.049978:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787430703.049988:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9540:x1874256847736192:12345-0@lo:502: 00000100:00100000:1.0:1787430703.050134:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9540:x1874256847736192:12345-0@lo:502: Request processed in 146us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.050141:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787430703.050200:0:9540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9540:1874256847736192:0@lo:502: 00000020:01000000:3.0:1787430703.050300:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430703.050309:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430703.050311:0:9540:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430703.050316:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430703.050317:0:9540:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787430703.050343:0:9540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9540:1874256847736320:0@lo:502: 00000100:00100000:3.0:1787430703.050394:0:9540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.050431:0:9540:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.050446:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736320 00000100:00100000:1.0:1787430703.050450:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736320 00000100:00100000:1.0:1787430703.050484:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787430703.050490:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9540:x1874256847736320:12345-0@lo:502: 00000100:00100000:1.0:1787430703.050550:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:9540:x1874256847736320:12345-0@lo:502: Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.050557:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787430703.050564:0:9540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9540:1874256847736320:0@lo:502: 00000020:01000000:3.0:1787430703.050579:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430703.050583:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430703.050585:0:9540:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787430703.050588:0:9540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787430703.050684:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787430703.050704:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787430703.050713:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.050730:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430703.050739:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787430703.050742:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c3a6a2800 from 39 10000000:01000000:1.0:1787430703.050745:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787430703.050767:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.050776:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.050784:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430703.050796:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736448:0@lo:101: 00000100:00100000:1.0:1787430703.050823:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.050850:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.050862:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736448 00000100:00100000:3.0:1787430703.050866:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736448 00000100:00100000:3.0:1787430703.050895:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787430703.050901:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847736448:12345-0@lo:101: 00010000:00010000:3.0:1787430703.050909:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430703.050920:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ec7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.051007:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.051016:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.051025:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b800, rc 0) 00000100:00100000:3.0:1787430703.051049:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847736448:12345-0@lo:101: Request processed in 148us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.051149:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736448:0@lo:101: 00010000:00010000:1.0:1787430703.051161:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.051170:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430703.051179:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787430703.051224:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736576:0@lo:501: 00000100:00100000:1.0:1787430703.051248:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.051279:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.051332:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736576 00000100:00100000:3.0:1787430703.051337:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736576 00000100:00100000:3.0:1787430703.051374:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787430703.051382:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847736576:12345-0@lo:501: 00000100:00100000:3.0:1787430703.051483:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847736576:12345-0@lo:501: Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.051490:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787430703.051666:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736576:0@lo:501: 00000100:00100000:0.0:1787430703.051693:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736704:0@lo:503: 00000100:00100000:0.0:1787430703.051726:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.051740:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430703.051751:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736704 00000100:00100000:0.0:1787430703.051755:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736704 00000100:00100000:0.0:1787430703.051781:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787430703.051787:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847736704:12345-0@lo:503: 00000100:00100000:0.0:1787430703.051849:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847736704:12345-0@lo:503: Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.051855:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787430703.051891:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847736704:0@lo:503: 00000100:00100000:0.0:1787430703.052044:0:9541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9541:1874256847736832:0@lo:502: 00000100:00100000:0.0:1787430703.052075:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.052091:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736832 00000100:00100000:0.0:1787430703.052094:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736832 00000100:00100000:0.0:1787430703.052124:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787430703.052130:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:9541:x1874256847736832:12345-0@lo:502: 00000100:00100000:0.0:1787430703.052189:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:9541:x1874256847736832:12345-0@lo:502: Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.052196:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787430703.052221:0:9541:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c079479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430703.052231:0:9541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9541:1874256847736832:0@lo:502: 00000100:00100000:0.0:1787430703.052265:0:9541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9541:1874256847736960:0@lo:502: 00000100:00100000:0.0:1787430703.052293:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.052314:0:9541:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c079479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.052325:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847736960 00000100:00100000:3.0:1787430703.052329:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847736960 00000100:00100000:3.0:1787430703.052365:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787430703.052372:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:9541:x1874256847736960:12345-0@lo:502: 00000100:00100000:3.0:1787430703.052433:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:9541:x1874256847736960:12345-0@lo:502: Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.052439:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787430703.052510:0:9541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9541:1874256847736960:0@lo:502: 00000040:00080000:0.0:1787430703.052528:0:9541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787430703.053330:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787430703.053350:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430703.053368:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.053378:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430703.053498:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787430703.053501:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a2800 from 6 10000000:01000000:1.0:1787430703.053503:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787430703.053527:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.053536:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.053545:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430703.053560:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737088:0@lo:101: 00000100:00100000:1.0:1787430703.053592:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.053677:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.054194:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737088 00000100:00100000:3.0:1787430703.054199:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737088 00000100:00100000:3.0:1787430703.054294:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787430703.054310:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847737088:12345-0@lo:101: 00010000:00010000:3.0:1787430703.054321:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430703.054335:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a800/0x4dbb683ba6a93edc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ed5 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.054369:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a800/0x4dbb683ba6a93edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ed5 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.054443:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a800/0x4dbb683ba6a93edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ed5 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.054452:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a800, rc 0) 00000100:00100000:3.0:1787430703.054493:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847737088:12345-0@lo:101: Request processed in 184us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.054499:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787430703.054782:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737088:0@lo:101: 00010000:00010000:1.0:1787430703.054794:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.054803:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430703.054856:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737216:0@lo:256: 00000100:00100000:1.0:1787430703.054886:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.054921:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.055313:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737216 00000100:00100000:3.0:1787430703.055318:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737216 00000100:00100000:3.0:1787430703.055346:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787430703.055365:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847737216:12345-0@lo:256: 20000000:01000000:3.0:1787430703.055380:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787430703.055397:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787430703.055400:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787430703.055469:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847737216:12345-0@lo:256: Request processed in 117us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.055477:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787430703.056055:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737216:0@lo:256: 10000000:01000000:1.0:1787430703.056099:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787430703.056105:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.056113:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430703.056121:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787430703.056123:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787430703.056125:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787430703.056143:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.056151:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.056159:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430703.056172:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737344:0@lo:101: 00000100:00100000:1.0:1787430703.056198:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.057430:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.058594:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737344 00000100:00100000:1.0:1787430703.058715:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737344 00000100:00100000:1.0:1787430703.058794:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787430703.058804:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847737344:12345-0@lo:101: 00010000:00010000:1.0:1787430703.058817:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430703.058833:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ee3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.058858:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.058869:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.058879:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef400, rc 0) 00000100:00100000:1.0:1787430703.058949:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847737344:12345-0@lo:101: Request processed in 147us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.058956:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787430703.058999:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737344:0@lo:101: 00010000:00010000:2.0:1787430703.059014:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.059024:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430703.059094:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737472:0@lo:501: 00000100:00100000:2.0:1787430703.059122:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.059156:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737472 00000100:00100000:2.0:1787430703.059156:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.059160:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737472 00000100:00100000:3.0:1787430703.059201:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787430703.059217:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847737472:12345-0@lo:501: 00000100:00100000:3.0:1787430703.059328:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847737472:12345-0@lo:501: Request processed in 121us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.059335:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787430703.059461:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737472:0@lo:501: 00000100:00100000:1.0:1787430703.059489:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737600:0@lo:503: 00000100:00100000:1.0:1787430703.059523:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.059537:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.059548:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737600 00000100:00100000:1.0:1787430703.059552:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737600 00000100:00100000:1.0:1787430703.059574:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787430703.059580:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847737600:12345-0@lo:503: 00000100:00100000:1.0:1787430703.059686:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847737600:12345-0@lo:503: Request processed in 105us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.059693:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787430703.059844:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847737600:0@lo:503: 00000100:00100000:2.0:1787430703.060338:0:9543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9543:1874256847737728:0@lo:502: 00000100:00100000:2.0:1787430703.060384:0:9543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.060455:0:9543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.060562:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737728 00000100:00100000:3.0:1787430703.060566:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737728 00000100:00100000:3.0:1787430703.060596:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787430703.060712:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:9543:x1874256847737728:12345-0@lo:502: 00000100:00100000:3.0:1787430703.060823:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:9543:x1874256847737728:12345-0@lo:502: Request processed in 113us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.060831:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787430703.061235:0:9543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9543:1874256847737728:0@lo:502: 00000020:01000000:2.0:1787430703.061257:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787430703.061265:0:9543:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787430703.061271:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430703.061273:0:9543:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787430703.061278:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787430703.061282:0:9543:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:2.0:1787430703.061302:0:9543:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787430703.061306:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430703.061319:0:9543:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e2b0355b370) 00000020:00000080:2.0:1787430703.061342:0:9543:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787430703.061347:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787430703.061554:0:9543:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787430703.061561:0:9543:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787430703.061568:0:9543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a93ef8 00010000:00080000:2.0:1787430703.061638:0:9543:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b03b44800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430703.061852:0:9543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787430703.061972:0:9543:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787430703.061982:0:9543:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787430703.062133:0:9543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430703.062246:0:9543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430703.062403:0:9543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787430703.062482:0:9543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787430703.063369:0:9544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430703.063374:0:9544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787430703.064955:0:9543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787430703.064966:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787430703.065004:0:9543:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787430703.065026:0:9543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a93eff 00000100:00080000:2.0:1787430703.065036:0:9543:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430703.065041:0:9543:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e2b03b44800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430703.065071:0:9543:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c3a63a300 x1874256847737856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430703.065297:0:9543:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787430703.065397:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430703.065401:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430703.065403:0:9543:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787430703.065406:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430703.065410:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430703.065411:0:9543:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787430703.065414:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787430703.065416:0:9543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787430703.065446:0:9543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9543:1874256847737984:0@lo:502: 00000100:00100000:2.0:1787430703.065516:0:9543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.065541:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847737856:0@lo:8: 00000100:00100000:2.0:1787430703.065551:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737984 00000100:00100000:2.0:1787430703.065555:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737984 00000100:00100000:0.0:1787430703.065573:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.065590:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787430703.065618:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:9543:x1874256847737984:12345-0@lo:502: 00000100:00100000:0.0:1787430703.065647:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847737856 00000100:00100000:0.0:1787430703.065651:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847737856 00000100:00100000:0.0:1787430703.065670:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787430703.065675:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1874256847737856:12345-0@lo:8: 00010000:00080000:0.0:1787430703.065695:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1787430703.065715:0:8411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a93f06 00000100:00100000:2.0:1787430703.065719:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:9543:x1874256847737984:12345-0@lo:502: Request processed in 120us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.065726:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00002000:00100000:0.0:1787430703.065733:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e2c3f8d5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787430703.065737:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1787430703.065740:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787430703.065759:0:9543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.065776:0:9543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9543:1874256847737984:0@lo:502: 00000020:01000000:2.0:1787430703.065798:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430703.065802:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00002000:00100000:0.0:1787430703.065802:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:2.0:1787430703.065804:0:9543:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787430703.065807:0:9543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1787430703.065855:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787430703.065874:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787430703.065883:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.065901:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430703.065911:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787430703.065913:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c04f2d000 from 39 10000000:01000000:2.0:1787430703.065916:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787430703.065936:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.065943:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.065952:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430703.065963:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847738112:0@lo:101: 00000100:00100000:2.0:1787430703.065989:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.066004:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.066017:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847738112 00000100:00100000:2.0:1787430703.066020:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847738112 00000100:00100000:2.0:1787430703.066041:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787430703.066047:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847738112:12345-0@lo:101: 00010000:00010000:2.0:1787430703.066055:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430703.066067:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93f0d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.066086:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.066105:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.066114:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174000, rc 0) 00000100:00100000:2.0:1787430703.066150:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847738112:12345-0@lo:101: Request processed in 102us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.066155:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787430703.066203:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847738112:0@lo:101: 00010000:00010000:1.0:1787430703.066225:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430703.066235:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430703.066282:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847738240:0@lo:501: 00000100:00100000:1.0:1787430703.066308:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.066332:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.066372:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847738240 00000100:00100000:2.0:1787430703.066376:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847738240 00000100:00100000:2.0:1787430703.066399:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787430703.066406:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847738240:12345-0@lo:501: 00002000:00080000:0.0:1787430703.066463:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787430703.066483:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f8d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430703.066521:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1874256847737856:12345-0@lo:8: Request processed in 845us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.066528:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787430703.066558:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2c3a63a300 x1874256847737856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430703.066568:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430703.066574:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787430703.066580:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787430703.066584:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787430703.066586:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b44800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787430703.066660:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787430703.066666:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847737856:0@lo:8: 00000100:00100000:2.0:1787430703.066989:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847738240:12345-0@lo:501: Request processed in 582us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.066996:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787430703.066999:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847738240:0@lo:501: 00000100:00100000:1.0:1787430703.067024:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847738368:0@lo:503: 00000100:00100000:1.0:1787430703.067056:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.067079:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.067106:0:9545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847738496:0@lo:700: 00000100:00100000:1.0:1787430703.067199:0:9545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.067306:0:9545:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aebf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430703.067339:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847738496 00000100:00100000:0.0:1787430703.067343:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847738496 00000100:00100000:0.0:1787430703.067428:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430703.067437:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9545:x1874256847738496:12345-0@lo:700: 00000100:00100000:0.0:1787430703.067462:0:8418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8418:1874256847738624:0@lo:700: 00000100:00100000:0.0:1787430703.067491:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.067508:0:8418:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430703.067526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847738624 00000100:00100000:0.0:1787430703.067530:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847738624 00000100:00100000:0.0:1787430703.067561:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430703.067567:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8418:x1874256847738624:12345-0@lo:700: 00000100:00080000:1.0:1787430703.067700:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430703.067873:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847738368 00000100:00100000:2.0:1787430703.067877:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847738368 00000100:00100000:2.0:1787430703.067899:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787430703.067906:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847738368:12345-0@lo:503: 00000100:00100000:2.0:1787430703.067993:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847738368:12345-0@lo:503: Request processed in 86us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.067999:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787430703.068014:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847738368:0@lo:503: 00000004:00080000:3.0:1787430703.068085:0:9544:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787430703.068131:0:9544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 164540528910ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787430703.068137:0:9544:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787430703.068994:0:9546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9546:1874256847738752:0@lo:502: 00000100:00100000:3.0:1787430703.069055:0:9546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.069426:0:9546:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656240 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.069461:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847738752 00000100:00100000:2.0:1787430703.069466:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847738752 00000100:00100000:2.0:1787430703.069541:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787430703.069552:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:9546:x1874256847738752:12345-0@lo:502: 00000100:00100000:2.0:1787430703.069914:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:9546:x1874256847738752:12345-0@lo:502: Request processed in 364us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.069929:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787430703.070052:0:9546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9546:1874256847738752:0@lo:502: 00000100:00100000:3.0:1787430703.070096:0:9546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9546:1874256847738880:0@lo:502: 00000100:00100000:3.0:1787430703.070135:0:9546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.070160:0:9546:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656240 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.070171:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847738880 00000100:00100000:2.0:1787430703.070176:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847738880 00000100:00100000:2.0:1787430703.070207:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787430703.070214:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:9546:x1874256847738880:12345-0@lo:502: 00000100:00100000:2.0:1787430703.070284:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:9546:x1874256847738880:12345-0@lo:502: Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.070290:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787430703.070342:0:9546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9546:1874256847738880:0@lo:502: 00000040:00080000:3.0:1787430703.070370:0:9546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787430703.070434:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787430703.070456:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787430703.070465:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.070476:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430703.070485:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787430703.070487:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c04f2d000 from 6 10000000:01000000:2.0:1787430703.070489:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787430703.070506:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.070512:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.070518:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430703.070526:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739008:0@lo:101: 00000100:00100000:2.0:1787430703.070548:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.070567:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02d97480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.070580:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739008 00000100:00100000:3.0:1787430703.070584:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739008 00000100:00100000:3.0:1787430703.070710:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787430703.070717:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847739008:12345-0@lo:101: 00010000:00010000:3.0:1787430703.070726:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430703.070737:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a000/0x4dbb683ba6a93f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93f1b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.070756:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a000/0x4dbb683ba6a93f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f1b expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.070766:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a000/0x4dbb683ba6a93f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f1b expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.070774:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a000, rc 0) 00000100:00100000:3.0:1787430703.070804:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847739008:12345-0@lo:101: Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.070810:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787430703.070995:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739008:0@lo:101: 00010000:00010000:2.0:1787430703.071004:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.071010:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430703.071039:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739136:0@lo:256: 00000100:00100000:2.0:1787430703.071060:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.071082:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02d97480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.071092:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739136 00000100:00100000:3.0:1787430703.071096:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739136 00000100:00100000:3.0:1787430703.071159:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787430703.071166:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847739136:12345-0@lo:256: 20000000:01000000:3.0:1787430703.071178:0:6489:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787430703.071195:0:6489:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787430703.071198:0:6489:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787430703.071283:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847739136:12345-0@lo:256: Request processed in 117us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.071287:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739136:0@lo:256: 00000100:00100000:3.0:1787430703.071290:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 10000000:01000000:2.0:1787430703.071323:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787430703.071328:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.071336:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430703.071342:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787430703.071344:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787430703.071346:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787430703.071373:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.071380:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.071396:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430703.071408:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739264:0@lo:101: 00000100:00100000:2.0:1787430703.071431:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.071445:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.071448:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739264 00000100:00100000:3.0:1787430703.071451:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739264 00000100:00100000:3.0:1787430703.071504:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787430703.071517:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847739264:12345-0@lo:101: 00010000:00010000:3.0:1787430703.071524:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430703.071532:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93f29 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.071545:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.071553:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.071560:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:3.0:1787430703.071597:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847739264:12345-0@lo:101: Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.071621:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787430703.071707:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739264:0@lo:101: 00010000:00010000:2.0:1787430703.071717:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.071726:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430703.071771:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739392:0@lo:501: 00000100:00100000:2.0:1787430703.071797:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.071905:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.071942:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739392 00000100:00100000:1.0:1787430703.071946:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739392 00000100:00100000:1.0:1787430703.071967:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787430703.071975:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847739392:12345-0@lo:501: 00000100:00100000:1.0:1787430703.072071:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847739392:12345-0@lo:501: Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.072078:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000004:00080000:0.0:1787430703.072149:0:7427:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787430703.072365:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739392:0@lo:501: 00000100:00100000:2.0:1787430703.072392:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739520:0@lo:503: 00000100:00100000:2.0:1787430703.072426:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430703.072442:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.072741:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739520 00000100:00100000:1.0:1787430703.072747:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739520 00000100:00100000:1.0:1787430703.072787:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787430703.072796:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847739520:12345-0@lo:503: 00000100:00100000:1.0:1787430703.072952:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847739520:12345-0@lo:503: Request processed in 156us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.072960:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787430703.073001:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847739520:0@lo:503: 40000000:02000000:3.0:1787430703.073297:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787430703.077558:0:9547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9547:1874256847739648:0@lo:502: 00000100:00100000:0.0:1787430703.077691:0:9547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.077707:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8418:x1874256847738624:12345-0@lo:700: Request processed in 10138us (10213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.077719:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430703.077755:0:9547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.077773:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739648 00000100:00100000:2.0:1787430703.077781:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739648 00000100:00100000:2.0:1787430703.077829:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787430703.077838:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:9547:x1874256847739648:12345-0@lo:502: 00010000:00080000:1.0:1787430703.077942:0:8418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03492a00 x1874256847738624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430703.077957:0:8418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8418:1874256847738624:0@lo:700: 40000000:02000000:1.0:1787430703.077967:0:8418:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1787430703.078004:0:9547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9547:1874256847739648:0@lo:502: 00000100:00100000:2.0:1787430703.078009:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:9547:x1874256847739648:12345-0@lo:502: Request processed in 169us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.078019:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000020:01000000:0.0:1787430703.078040:0:9547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787430703.078048:0:9547:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787430703.078056:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430703.078059:0:9547:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787430703.078065:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787430703.078069:0:9547:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:0.0:1787430703.078093:0:9547:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787430703.078096:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430703.078121:0:9547:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e2b03b98000) 00000020:00000080:0.0:1787430703.078146:0:9547:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1787430703.078152:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787430703.078229:0:9547:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787430703.078235:0:9547:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787430703.078241:0:9547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a93f3e 00010000:00080000:0.0:1787430703.078270:0:9547:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c3f8d4000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1787430703.078487:0:9547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1787430703.078583:0:9547:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787430703.078591:0:9547:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787430703.078735:0:9547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430703.078804:0:9547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430703.078900:0:9547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787430703.078954:0:9547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787430703.079170:0:9548:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430703.079174:0:9548:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787430703.079816:0:9547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430703.079824:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787430703.079863:0:9547:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787430703.079886:0:9547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a93f45 00000100:00080000:0.0:1787430703.079896:0:9547:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787430703.079901:0:9547:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2c3f8d4000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430703.079930:0:9547:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03490000 x1874256847739776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430703.079977:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847739776:0@lo:8: 00000100:00100000:2.0:1787430703.080028:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.080078:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739776 00000100:00100000:3.0:1787430703.080085:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739776 00000100:00100000:3.0:1787430703.080181:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430703.080188:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1874256847739776:12345-0@lo:8: 00010000:00080000:3.0:1787430703.080269:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1787430703.080293:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a93f4c 00002000:00100000:3.0:1787430703.080307:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e2b0361e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787430703.080310:0:8408:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787430703.080317:0:8408:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787430703.080380:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787430703.080399:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8e2b0361c000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787430703.080452:0:9547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787430703.080500:0:9547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430703.080505:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430703.080506:0:9547:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787430703.080510:0:9547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430703.080514:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430703.080515:0:9547:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787430703.080518:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787430703.080520:0:9547:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787430703.080541:0:9547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9547:1874256847739904:0@lo:502: 00000100:00100000:0.0:1787430703.080583:0:9547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.080652:0:9547:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947540 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.080799:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1874256847739776:12345-0@lo:8: Request processed in 581us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.080807:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430703.082722:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847739904 00000100:00100000:0.0:1787430703.082733:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847739904 00000100:00100000:0.0:1787430703.082795:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787430703.082804:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:9547:x1874256847739904:12345-0@lo:502: 00000100:00100000:0.0:1787430703.082942:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:9547:x1874256847739904:12345-0@lo:502: Request processed in 139us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.082949:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787430703.083002:0:9547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:9547:1874256847739904:0@lo:502: 00000020:01000000:0.0:1787430703.083026:0:9547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430703.083032:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430703.083034:0:9547:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787430703.083044:0:9547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1787430703.083097:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1787430703.083116:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787430703.083125:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430703.083136:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430703.083145:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787430703.083148:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e2c10964d28 from 1 10000000:01000000:0.0:1787430703.083151:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787430703.083177:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430703.083185:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430703.083194:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430703.083209:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847740032:0@lo:101: 00000100:00100000:0.0:1787430703.083240:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.083264:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947540 going to sleep for 11 seconds 00010000:00080000:2.0:1787430703.083402:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b03490000 x1874256847739776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430703.083412:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787430703.083418:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787430703.083426:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787430703.083430:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787430703.083434:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f8d4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787430703.083461:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740032 00000100:00100000:3.0:1787430703.083467:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740032 00000004:00080000:2.0:1787430703.083479:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787430703.083486:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847739776:0@lo:8: 00000100:00100000:3.0:1787430703.083491:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787430703.083497:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847740032:12345-0@lo:101: 00010000:00010000:3.0:1787430703.083504:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430703.083518:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93f53 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.083538:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.083548:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.083557:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a400, rc 0) 00000100:00100000:3.0:1787430703.083645:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847740032:12345-0@lo:101: Request processed in 148us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.083651:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787430703.083683:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847740032:0@lo:101: 00010000:00010000:3.0:1787430703.083695:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.083705:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430703.083761:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847740160:0@lo:501: 00000004:00080000:0.0:1787430703.083797:0:9548:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787430703.083801:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.083819:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.083899:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740160 00000100:00100000:3.0:1787430703.083903:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740160 00000100:00100000:3.0:1787430703.083925:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787430703.083942:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847740160:12345-0@lo:501: 00000100:00100000:3.0:1787430703.084044:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847740160:12345-0@lo:501: Request processed in 98us (226us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430703.084051:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000004:00080000:0.0:1787430703.084112:0:9548:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164556510000ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787430703.084120:0:9548:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787430703.084365:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847740160:0@lo:501: 10000000:01000000:3.0:1787430703.084402:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787430703.084408:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430703.084416:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787430703.084476:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787430703.084480:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787430703.084631:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9545:x1874256847738496:12345-0@lo:700: Request processed in 17163us (17398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.084642:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787430703.084649:0:9545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b03578a80 x1874256847738496/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.084661:0:9545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847738496:0@lo:700: 00000100:00100000:2.0:1787430703.084784:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1787430703.084804:0:9549:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787430703.084823:0:9549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847740416:0@lo:7: 00000100:00100000:0.0:1787430703.084853:0:9549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.084884:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740416 00000100:00100000:0.0:1787430703.084889:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740416 00000100:00100000:0.0:1787430703.084932:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430703.084940:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9549:x1874256847740416:12345-0@lo:7: 00000100:00080000:3.0:1787430703.084998:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787430703.085632:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787430703.086450:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847740288:0@lo:13: 00000100:00100000:2.0:1787430703.086506:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.086623:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740288 00000100:00100000:3.0:1787430703.086631:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740288 00000100:00100000:3.0:1787430703.086673:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430703.086682:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847740288:12345-0@lo:13: 00002000:00000024:3.0:1787430703.086700:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1787430703.086741:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847740288:12345-0@lo:13: Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.086748:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:0.0:1787430703.087791:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787430703.087797:0:8411:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787430703.087840:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9549:x1874256847740416:12345-0@lo:7: Request processed in 2901us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.087847:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430703.087874:0:9549:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c079476c0 going to sleep for 11 seconds 00010000:00080000:0.0:1787430703.087891:0:9549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b03493b80 x1874256847740416/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430703.087901:0:9549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847740416:0@lo:7: 00000004:00080000:0.0:1787430703.087909:0:9549:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787430703.087931:0:9549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847740544:0@lo:5: 00000100:00100000:0.0:1787430703.087955:0:9549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.087981:0:9549:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c079476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.088018:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740544 00000100:00100000:3.0:1787430703.088024:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740544 00010000:00080000:1.0:1787430703.088059:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b03493800 x1874256847740288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.088062:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430703.088070:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9549:x1874256847740544:12345-0@lo:5: 00000100:00100000:1.0:1787430703.088074:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847740288:0@lo:13: 00002000:00080000:3.0:1787430703.088089:0:8408:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787430703.088093:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787430703.088296:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9549:x1874256847740544:12345-0@lo:5: Request processed in 226us (339us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787430703.088303:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787430703.088318:0:9549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b03493b80 x1874256847740544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430703.088329:0:9549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847740544:0@lo:5: 00000004:00080000:0.0:1787430703.088337:0:9549:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787430703.088371:0:9549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847740672:0@lo:700: 00000100:00100000:0.0:1787430703.088394:0:9549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.088418:0:9549:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c079476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.088474:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740672 00000100:00100000:2.0:1787430703.088479:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740672 00000100:00100000:2.0:1787430703.088506:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787430703.088513:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9549:x1874256847740672:12345-0@lo:700: 00000100:00100000:1.0:1787430703.091637:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847740800:0@lo:13: 00000100:00100000:1.0:1787430703.091698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787430703.091717:0:9545:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787430703.091739:0:9545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847740928:0@lo:7: 00000100:00100000:3.0:1787430703.091767:0:9545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.091799:0:9545:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430703.091847:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740800 00000100:00100000:0.0:1787430703.091854:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740800 00000100:00100000:0.0:1787430703.091907:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430703.091916:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847740800:12345-0@lo:13: 00002000:00000024:0.0:1787430703.091944:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1787430703.091994:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847740800:12345-0@lo:13: Request processed in 79us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430703.092001:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787430703.092119:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b034f8380 x1874256847740800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.092140:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847740800:0@lo:13: 00000100:00100000:1.0:1787430703.092189:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847740928 00000100:00100000:1.0:1787430703.092194:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847740928 00000100:00100000:1.0:1787430703.092224:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787430703.092231:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9545:x1874256847740928:12345-0@lo:7: 00002000:00080000:1.0:1787430703.099031:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787430703.099040:0:8411:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787430703.099132:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9545:x1874256847740928:12345-0@lo:7: Request processed in 6897us (7359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.099148:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000001:00080000:3.0:1787430703.099327:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:3.0:1787430703.099387:0:9545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b034faa00 x1874256847740928/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.099415:0:9545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847740928:0@lo:7: 00000004:00080000:3.0:1787430703.099429:0:9545:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787430703.099464:0:9545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847741056:0@lo:5: 00000100:00100000:3.0:1787430703.099499:0:9545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.099535:0:9545:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430703.099824:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9549:x1874256847740672:12345-0@lo:700: Request processed in 11310us (11428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.099839:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787430703.099860:0:9549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b03491500 x1874256847740672/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430703.099870:0:9549:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787430703.099880:0:9549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847740672:0@lo:700: 00000100:00100000:1.0:1787430703.099998:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741056 00000100:00100000:1.0:1787430703.100005:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741056 00000100:00100000:1.0:1787430703.100073:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787430703.100081:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9545:x1874256847741056:12345-0@lo:5: 00002000:00080000:1.0:1787430703.100104:0:8409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787430703.100136:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9545:x1874256847741056:12345-0@lo:5: Request processed in 56us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.100142:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787430703.100861:0:9545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b034faa00 x1874256847741056/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.100869:0:9545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847741056:0@lo:5: 00000004:00080000:3.0:1787430703.100876:0:9545:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787430703.101007:0:9545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847741184:0@lo:5: 00000004:02000040:0.0:1787430703.101155:0:9549:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787430703.101183:0:9545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.101310:0:9545:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.101362:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741184 00000100:00100000:1.0:1787430703.101367:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741184 00000100:00100000:1.0:1787430703.101407:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430703.101416:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9545:x1874256847741184:12345-0@lo:5: 00002000:00080000:1.0:1787430703.101444:0:8830:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1787430703.104591:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9545:x1874256847741184:12345-0@lo:5: Request processed in 3170us (3401us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787430703.104620:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787430703.104755:0:9545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e2b034faa00 x1874256847741184/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.104773:0:9545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9545:1874256847741184:0@lo:5: 00000004:00080000:3.0:1787430703.104787:0:9545:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787430703.104825:0:9545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9545:1874256847741312:0@lo:900: 00000100:00100000:3.0:1787430703.104862:0:9545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430703.104926:0:9545:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430703.104965:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741312 00000100:00100000:1.0:1787430703.104972:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741312 00000100:00100000:1.0:1787430703.105058:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430703.105067:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9545:x1874256847741312:12345-0@lo:900: 00000100:00100000:1.0:1787430703.105127:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9545:x1874256847741312:12345-0@lo:900: Request processed in 61us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.105133:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787430703.105291:0:9545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b034f8a80 x1874256847741312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.105301:0:9545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9545:1874256847741312:0@lo:900: 00000100:00100000:0.0:1787430703.105522:0:9549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847741440:0@lo:5: 00000100:00100000:0.0:1787430703.105552:0:9549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430703.105581:0:9549:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c079476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430703.105837:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741440 00000100:00100000:3.0:1787430703.105851:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741440 00000100:00100000:3.0:1787430703.106021:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787430703.106030:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9549:x1874256847741440:12345-0@lo:5: 00010000:00010000:2.0:1787430703.106176:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787430703.109419:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787430703.109440:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1787430703.114344:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9549:x1874256847741440:12345-0@lo:5: Request processed in 8309us (8785us total) trans 4294967299 rc 0/0 00010000:00080000:0.0:1787430703.114382:0:9549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03491500 x1874256847741440/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430719 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430703.114402:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430703.114402:0:9549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9549:1874256847741440:0@lo:5: 00000004:00080000:0.0:1787430703.114415:0:9549:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:0.0:1787430703.197707:0:9569:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430703.197930:0:9569:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787430703.359850:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847741568:0@lo:41: 00000100:00100000:2.0:1787430703.359921:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430703.360064:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741568 00000100:00100000:1.0:1787430703.360072:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741568 00000100:00100000:1.0:1787430703.360117:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430703.360125:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847741568:12345-0@lo:41: 00000004:00000024:1.0:1787430703.360173:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787430703.360221:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847741568:12345-0@lo:41: Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.360228:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787430703.360383:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847741568:0@lo:41: 00010000:00010000:1.0:1787430704.138878:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430705.151893:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430705.920753:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787430705.920789:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847741696:0@lo:13: 00000100:00100000:2.0:1787430705.920870:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430705.920950:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741696 00000100:00100000:2.0:1787430705.920958:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741696 00000100:00100000:2.0:1787430705.921010:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787430705.921019:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847741696:12345-0@lo:13: 00002000:00000024:2.0:1787430705.921047:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430705.921091:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847741696:12345-0@lo:13: Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430705.921099:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787430705.921118:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787430705.921147:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a639c00 x1874256847741696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430705.921165:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847741696:0@lo:13: 00000100:00100000:3.0:1787430705.923398:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847741824:0@lo:13: 00000100:00100000:3.0:1787430705.923454:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430705.923516:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741824 00000100:00100000:3.0:1787430705.923523:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741824 00000100:00100000:3.0:1787430705.923573:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430705.923583:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847741824:12345-0@lo:13: 00002000:00000024:3.0:1787430705.923626:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430705.923667:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847741824:12345-0@lo:13: Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430705.923675:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787430705.923695:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787430705.923723:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034f8a80 x1874256847741824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430705.923739:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847741824:0@lo:13: 00000100:00100000:3.0:1787430705.924279:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847741952:0@lo:41: 00000100:00100000:3.0:1787430705.924324:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430705.924402:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847741952 00000100:00100000:1.0:1787430705.924408:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847741952 00000100:00100000:1.0:1787430705.924442:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787430705.925141:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847741952:12345-0@lo:41: 00000004:00000024:1.0:1787430705.925166:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787430705.926642:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847741952:12345-0@lo:41: Request processed in 2190us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430705.926651:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430705.926694:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847741952:0@lo:41: 00010000:00010000:2.0:1787430706.175702:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430706.261508:0:9858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1787430706.851091:0:9910:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430706.851330:0:9910:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787430707.199765:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787430707.420451:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787430707.420465:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787430708.223938:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430708.479861:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847742208:0@lo:41: 00000100:00100000:1.0:1787430708.479950:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430708.480010:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847742080:0@lo:13: 00000100:00100000:1.0:1787430708.480037:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430708.480080:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430708.480087:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847742336:0@lo:13: 00000100:00100000:1.0:1787430708.480111:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430708.480144:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742208 00000100:00100000:1.0:1787430708.480151:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742208 00000100:00100000:2.0:1787430708.480198:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742080 00000100:00100000:2.0:1787430708.480204:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742080 00000100:00100000:3.0:1787430708.480205:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847742464:0@lo:400: 00000100:00100000:1.0:1787430708.480244:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787430708.480245:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430708.480246:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742336 00000100:00100000:2.0:1787430708.480250:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742336 00000100:00100000:1.0:1787430708.480257:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847742208:12345-0@lo:41: 00000100:00100000:2.0:1787430708.480280:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787430708.480290:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847742080:12345-0@lo:13: 00000004:00000024:1.0:1787430708.480298:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00002000:00000024:2.0:1787430708.480325:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430708.480388:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847742080:12345-0@lo:13: Request processed in 100us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.480391:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847742208:12345-0@lo:41: Request processed in 136us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.480401:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430708.480406:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787430708.480426:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787430708.480434:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847742336:12345-0@lo:13: 00002000:00000024:2.0:1787430708.480444:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430708.480468:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847742336:12345-0@lo:13: Request processed in 36us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.480473:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430708.480479:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847742208:0@lo:41: 00010000:00080000:1.0:1787430708.480497:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03491180 x1874256847742080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430708.480507:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787430708.480508:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430708.480514:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847742592:0@lo:400: 00000100:00100000:1.0:1787430708.480522:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847742080:0@lo:13: 00010000:00080000:1.0:1787430708.480540:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a639c00 x1874256847742336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430708.480544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430708.480548:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787430708.480558:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847742336:0@lo:13: 00000100:00080000:3.0:1787430708.480568:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430708.480577:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742592 00000100:00100000:3.0:1787430708.480579:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742464 00000100:00100000:1.0:1787430708.480580:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742592 00000100:00100000:3.0:1787430708.480581:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742464 00000100:00100000:1.0:1787430708.480626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430708.480633:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787430708.480633:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847742592:12345-0@lo:400: 00000100:00100000:3.0:1787430708.480638:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847742464:12345-0@lo:400: 00000100:00100000:3.0:1787430708.480668:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847742464:12345-0@lo:400: Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.480668:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847742592:12345-0@lo:400: Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430708.480675:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787430708.480675:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787430708.480710:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03492680 x1874256847742592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430708.480720:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847742592:0@lo:400: 00000100:00100000:3.0:1787430708.480731:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847742464:0@lo:400: 00000100:00100000:3.0:1787430708.480863:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430708.480903:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847742848:0@lo:400: 00000100:00100000:3.0:1787430708.480929:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430708.480947:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847742720:0@lo:400: 00000100:00100000:3.0:1787430708.480965:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430708.480988:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742848 00000100:00100000:3.0:1787430708.480991:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742848 00000100:00100000:3.0:1787430708.481011:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787430708.481017:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847742848:12345-0@lo:400: 00000100:00100000:3.0:1787430708.481053:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847742848:12345-0@lo:400: Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430708.481059:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787430708.481084:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03491c00 x1874256847742848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430708.481093:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847742848:0@lo:400: 00000100:00100000:1.0:1787430708.481438:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742720 00000100:00100000:1.0:1787430708.481443:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742720 00000100:00100000:1.0:1787430708.481533:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430708.481542:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847742720:12345-0@lo:400: 00000100:00100000:1.0:1787430708.481585:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847742720:12345-0@lo:400: Request processed in 44us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.481591:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430708.481671:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847742720:0@lo:400: 00000100:00100000:0.0:1787430708.485243:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847742976:0@lo:400: 00000100:00100000:0.0:1787430708.485335:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.485369:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847743488:0@lo:400: 00000100:00100000:0.0:1787430708.485392:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.485414:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787430708.485427:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847743104:0@lo:400: 00000100:00100000:0.0:1787430708.485451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.485470:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847743616:0@lo:400: 00000100:00100000:0.0:1787430708.485489:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.485517:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847742976 00000100:00100000:0.0:1787430708.485525:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847742976 00000100:00100000:0.0:1787430708.485571:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847743488 00000100:00100000:0.0:1787430708.485574:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847743488 00000100:00100000:0.0:1787430708.485588:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847743104 00000100:00100000:0.0:1787430708.485591:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847743104 00000100:00100000:0.0:1787430708.485625:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847743616 00000100:00100000:0.0:1787430708.485628:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847743616 00000100:00100000:0.0:1787430708.485645:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430708.485654:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847742976:12345-0@lo:400: 00000100:00100000:0.0:1787430708.485705:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847742976:12345-0@lo:400: Request processed in 52us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.485712:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430708.485728:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430708.485735:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847743488:12345-0@lo:400: 00000100:00100000:0.0:1787430708.485762:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847743488:12345-0@lo:400: Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.485768:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430708.485779:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787430708.485786:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847743104:12345-0@lo:400: 00000100:00100000:0.0:1787430708.485811:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847743104:12345-0@lo:400: Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.485818:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787430708.485829:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430708.485841:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847743616:12345-0@lo:400: 00000100:00100000:0.0:1787430708.485869:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847743616:12345-0@lo:400: Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.485874:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787430708.485890:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430708.485894:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787430708.485926:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03493100 x1874256847743104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430708.485940:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847743104:0@lo:400: 00010000:00080000:0.0:1787430708.485952:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03490e00 x1874256847743616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430708.485960:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847743616:0@lo:400: 00010000:00080000:0.0:1787430708.485968:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03490380 x1874256847742976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430708.485975:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847742976:0@lo:400: 00010000:00080000:0.0:1787430708.485983:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03491c00 x1874256847743488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430708.485991:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847743488:0@lo:400: 00000100:00100000:0.0:1787430708.486020:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847743232:0@lo:400: 00000100:00100000:0.0:1787430708.486048:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.486066:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430708.486072:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847743360:0@lo:400: 00000100:00100000:0.0:1787430708.486092:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.486117:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847743232 00000100:00100000:0.0:1787430708.486127:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847743232 00000100:00100000:0.0:1787430708.486195:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847743360 00000100:00100000:0.0:1787430708.486198:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847743360 00000100:00100000:0.0:1787430708.486223:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430708.486230:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847743232:12345-0@lo:400: 00000100:00100000:0.0:1787430708.486263:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847743232:12345-0@lo:400: Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.486269:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430708.486281:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430708.486287:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847743360:12345-0@lo:400: 00000100:00100000:0.0:1787430708.486328:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847743360:12345-0@lo:400: Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.486334:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787430708.486351:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787430708.486367:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03491f80 x1874256847743360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430708.486376:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847743360:0@lo:400: 00010000:00080000:0.0:1787430708.486387:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03490a80 x1874256847743232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430708.486395:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847743232:0@lo:400: 00000020:00000004:2.0:1787430709.009373:0:10012:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430709.009914:0:10012:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787430709.247794:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787430709.619059:0:10060:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787430709.619070:0:10060:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1787430709.931027:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430709.931103:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836165760 00000100:00100000:2.0:1787430709.931115:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836165760 00000100:00100000:2.0:1787430709.931154:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:2.0:1787430709.931163:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1874256836165760:12345-192.168.202.25@tcp:250: 00010000:00080000:2.0:1787430709.931190:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 71807ffe-f1d6-4473-b7d7-5788186ad6db@192.168.202.25@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1787430709.931227:0:6489:0:(genops.c:1385:class_connect()) connect: client 71807ffe-f1d6-4473-b7d7-5788186ad6db, cookie 0x4dbb683ba6a93f61 00000100:00080000:2.0:1787430709.931545:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b45800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430709.931646:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+5:2398:x1874256836165760:12345-192.168.202.25@tcp:250: Request processed in 481us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430709.931669:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:2.0:1787430709.948886:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430709.949441:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836165888 00000100:00100000:3.0:1787430709.949454:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836165888 00000100:00100000:3.0:1787430709.952916:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 176 00000100:00100000:3.0:1787430709.952940:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+5:6148:x1874256836165888:12345-192.168.202.25@tcp:101: 00010000:00010000:3.0:1787430709.952958:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430709.952976:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91386f3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430709.953006:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430709.953017:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430709.953027:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8aa00, rc 0) 00000100:00100000:3.0:1787430709.953106:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+6:6148:x1874256836165888:12345-192.168.202.25@tcp:101: Request processed in 176us (4229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430709.953113:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 176 00000100:00100000:1.0:1787430709.955180:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430709.955441:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166016 00000100:00100000:2.0:1787430709.955452:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166016 00000100:00100000:2.0:1787430709.955621:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 177 00000100:00100000:2.0:1787430709.955633:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+6:6148:x1874256836166016:12345-192.168.202.25@tcp:501: 00000100:00100000:2.0:1787430709.955755:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+6:6148:x1874256836166016:12345-192.168.202.25@tcp:501: Request processed in 124us (583us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787430709.955763:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 177 00000100:00100000:1.0:1787430709.957298:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430709.957873:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166144 00000100:00100000:0.0:1787430709.957883:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166144 00000100:00100000:0.0:1787430709.957924:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:0.0:1787430709.957934:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+6:6148:x1874256836166144:12345-192.168.202.25@tcp:101: 00010000:00010000:0.0:1787430709.957948:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430709.957977:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91386fa expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.958005:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.958016:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.958025:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1dc00, rc 0) 00000100:00100000:0.0:1787430709.958114:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+7:6148:x1874256836166144:12345-192.168.202.25@tcp:101: Request processed in 180us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.958121:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:1.0:1787430709.959936:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430709.960008:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166272 00000100:00100000:0.0:1787430709.960017:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166272 00000100:00100000:0.0:1787430709.960056:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:0.0:1787430709.960065:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+7:6148:x1874256836166272:12345-192.168.202.25@tcp:501: 00000100:00100000:0.0:1787430709.960207:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6148:x1874256836166272:12345-192.168.202.25@tcp:501: Request processed in 142us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.960214:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:1.0:1787430709.961708:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430709.961863:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166400 00000100:00100000:2.0:1787430709.961871:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166400 00000100:00100000:2.0:1787430709.961920:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:2.0:1787430709.961930:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6148:x1874256836166400:12345-192.168.202.25@tcp:503: 00000100:00100000:2.0:1787430709.962050:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6148:x1874256836166400:12345-192.168.202.25@tcp:503: Request processed in 120us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430709.962058:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:1.0:1787430709.964697:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430709.964782:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166528 00000100:00100000:2.0:1787430709.964791:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166528 00000100:00100000:2.0:1787430709.964841:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:2.0:1787430709.964850:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6167:x1874256836166528:12345-192.168.202.25@tcp:502: 00000100:00100000:2.0:1787430709.964989:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6167:x1874256836166528:12345-192.168.202.25@tcp:502: Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430709.964997:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:1.0:1787430709.989986:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430709.990087:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166656 00000100:00100000:0.0:1787430709.990097:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166656 00000100:00100000:0.0:1787430709.990160:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:0.0:1787430709.990172:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6167:x1874256836166656:12345-192.168.202.25@tcp:502: 00000100:00100000:0.0:1787430709.990348:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6167:x1874256836166656:12345-192.168.202.25@tcp:502: Request processed in 178us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.990357:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:1.0:1787430709.998793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430709.998895:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166784 00000100:00100000:3.0:1787430709.998916:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166784 00000100:00100000:3.0:1787430709.998975:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:3.0:1787430709.998987:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6148:x1874256836166784:12345-192.168.202.25@tcp:101: 00010000:00010000:3.0:1787430709.999005:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430709.999024:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b000/0x4dbb683ba6a93f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913872b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430709.999053:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b000/0x4dbb683ba6a93f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913872b expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430709.999064:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b000/0x4dbb683ba6a93f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913872b expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430709.999074:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b000, rc 0) 00000100:00100000:3.0:1787430709.999132:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6148:x1874256836166784:12345-192.168.202.25@tcp:101: Request processed in 147us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430709.999139:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:1.0:1787430710.002356:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430710.002514:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836166912 00000100:00100000:2.0:1787430710.002654:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836166912 00000100:00100000:3.0:1787430710.003001:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:3.0:1787430710.003016:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6148:x1874256836166912:12345-192.168.202.25@tcp:256: 20000000:01000000:3.0:1787430710.003040:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787430710.003058:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787430710.003063:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787430710.003066:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787430710.003069:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787430710.003071:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787430710.005801:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6148:x1874256836166912:12345-192.168.202.25@tcp:256: Request processed in 2780us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430710.005817:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:1.0:1787430710.008572:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430710.008903:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167040 00000100:00100000:0.0:1787430710.008926:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167040 00000100:00100000:0.0:1787430710.009038:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:0.0:1787430710.009050:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6148:x1874256836167040:12345-192.168.202.25@tcp:101: 00010000:00010000:0.0:1787430710.009066:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430710.009083:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138732 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.009112:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.009123:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.009133:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d200, rc 0) 00000100:00100000:0.0:1787430710.009188:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6148:x1874256836167040:12345-192.168.202.25@tcp:101: Request processed in 141us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.009196:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:1.0:1787430710.010994:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430710.011044:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167168 00000100:00100000:3.0:1787430710.011053:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167168 00000100:00100000:3.0:1787430710.011098:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00100000:3.0:1787430710.011109:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6148:x1874256836167168:12345-192.168.202.25@tcp:501: 00000100:00100000:3.0:1787430710.011269:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6148:x1874256836167168:12345-192.168.202.25@tcp:501: Request processed in 163us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430710.011278:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00100000:1.0:1787430710.012987:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430710.013073:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167296 00000100:00100000:0.0:1787430710.013081:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167296 00000100:00100000:0.0:1787430710.013131:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:0.0:1787430710.013142:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6148:x1874256836167296:12345-192.168.202.25@tcp:503: 00000100:00100000:0.0:1787430710.013271:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6148:x1874256836167296:12345-192.168.202.25@tcp:503: Request processed in 130us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.013299:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:1.0:1787430710.016701:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430710.017105:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167424 00000100:00100000:2.0:1787430710.017115:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167424 00000100:00100000:2.0:1787430710.017179:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:2.0:1787430710.017189:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6173:x1874256836167424:12345-192.168.202.25@tcp:502: 00000100:00100000:2.0:1787430710.017340:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6173:x1874256836167424:12345-192.168.202.25@tcp:502: Request processed in 152us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.017348:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:1.0:1787430710.018938:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430710.019001:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167552 00000100:00100000:2.0:1787430710.019007:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167552 00000100:00100000:2.0:1787430710.019046:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:2.0:1787430710.019057:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6173:x1874256836167552:12345-192.168.202.25@tcp:502: 00000100:00100000:2.0:1787430710.019192:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6173:x1874256836167552:12345-192.168.202.25@tcp:502: Request processed in 137us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.019200:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:1.0:1787430710.021820:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430710.022015:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167680 00000100:00100000:0.0:1787430710.022026:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167680 00000100:00100000:1.0:1787430710.022036:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430710.022167:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167936 00000100:00100000:0.0:1787430710.022172:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167936 00000100:00100000:0.0:1787430710.022243:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1787430710.022251:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1874256836167680:12345-192.168.202.25@tcp:38: 00010000:00080000:0.0:1787430710.022279:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1787430710.022339:0:6499:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a93f84 00000100:00100000:3.0:1787430710.022371:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000004:00100000:0.0:1787430710.022375:0:6499:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787430710.022382:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874256836167936:12345-192.168.202.25@tcp:38: 00010000:00080000:3.0:1787430710.022402:0:8819:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:3.0:1787430710.022440:0:8819:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a93f8b 00000004:00100000:3.0:1787430710.022454:0:8819:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787430710.022774:0:8819:0:(import.c:65:import_set_state_nolock()) ffff8e2b0361f000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787430710.022775:0:6499:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f8d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430710.022843:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836167680:12345-192.168.202.25@tcp:38: Request processed in 590us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.022851:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:3.0:1787430710.022966:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836167936:12345-192.168.202.25@tcp:38: Request processed in 585us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430710.022974:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00010000:00010000:2.0:1787430710.271748:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430711.027337:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430711.027456:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430711.028611:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430711.028673:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168192 00000100:00100000:0.0:1787430711.028681:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168192 00000100:00100000:0.0:1787430711.028807:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836167808 00000100:00100000:0.0:1787430711.028810:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836167808 00000100:00100000:0.0:1787430711.028827:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1787430711.028834:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:6148:x1874256836168192:12345-192.168.202.25@tcp:41: 00000004:00000024:0.0:1787430711.028873:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787430711.028931:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:6148:x1874256836168192:12345-192.168.202.25@tcp:41: Request processed in 97us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430711.028939:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1787430711.029033:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1787430711.029039:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836167808:12345-192.168.202.25@tcp:41: 00000004:00000024:0.0:1787430711.029047:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787430711.029062:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836167808:12345-192.168.202.25@tcp:41: Request processed in 24us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430711.029065:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00080000:2.0:1787430711.029337:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430711.029438:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168064 00000100:00100000:0.0:1787430711.029454:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168064 00000100:00100000:0.0:1787430711.029494:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1787430711.029502:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836168064:12345-192.168.202.25@tcp:41: 00000004:00000024:0.0:1787430711.029518:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787430711.029545:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836168064:12345-192.168.202.25@tcp:41: Request processed in 44us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430711.029551:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00080000:2.0:1787430711.029617:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430711.032418:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430711.032536:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168320 00000100:00100000:2.0:1787430711.032543:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168320 00000100:00100000:2.0:1787430711.032629:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:2.0:1787430711.032636:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6148:x1874256836168320:12345-192.168.202.25@tcp:40: 00000100:00100000:2.0:1787430711.032705:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6148:x1874256836168320:12345-192.168.202.25@tcp:40: Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430711.032710:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:1.0:1787430711.034257:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430711.034313:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430711.034323:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168704 00000100:00100000:0.0:1787430711.034331:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168704 00000100:00100000:1.0:1787430711.034335:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430711.034376:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:0.0:1787430711.034385:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6148:x1874256836168704:12345-192.168.202.25@tcp:900: 00000100:00100000:1.0:1787430711.034397:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430711.034421:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168448 00000100:00100000:1.0:1787430711.034425:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168448 00000100:00100000:0.0:1787430711.034439:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6148:x1874256836168704:12345-192.168.202.25@tcp:900: Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430711.034440:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168576 00000100:00100000:1.0:1787430711.034442:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168576 00000100:00100000:0.0:1787430711.034446:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1787430711.034455:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1787430711.034470:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874256836168448:12345-192.168.202.25@tcp:8: 00010000:00080000:1.0:1787430711.034493:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1787430711.034539:0:8409:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a93f92 00002000:00100000:1.0:1787430711.034551:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 419b0c27-15f9-4e73-995a-bc02788ae1b0/ffff8e2b02bb9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787430711.034569:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787430711.034769:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787430711.034797:0:8409:0:(import.c:65:import_set_state_nolock()) ffff8e2b02bbb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430711.034810:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1787430711.034815:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874256836168576:12345-192.168.202.25@tcp:8: 00010000:00080000:2.0:1787430711.034831:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 172 last 0 00000100:00100000:1.0:1787430711.034839:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836168448:12345-192.168.202.25@tcp:8: Request processed in 368us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430711.034845:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1787430711.034877:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168832 00000100:00100000:1.0:1787430711.034881:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168832 00000100:00100000:1.0:1787430711.034904:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:1.0:1787430711.034911:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2402:x1874256836168832:12345-192.168.202.25@tcp:400: 00000100:00100000:1.0:1787430711.034935:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2402:x1874256836168832:12345-192.168.202.25@tcp:400: Request processed in 25us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430711.034941:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 190 00000020:00000080:2.0:1787430711.035169:0:8411:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a93f99 00002000:00100000:2.0:1787430711.035176:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 419b0c27-15f9-4e73-995a-bc02788ae1b0/ffff8e2b03b46000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430711.035190:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787430711.035721:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787430711.035745:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b41800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430711.035786:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836168576:12345-192.168.202.25@tcp:8: Request processed in 969us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430711.035794:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1787430711.039290:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430711.039387:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836168960 00000100:00100000:2.0:1787430711.039395:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836168960 00000100:00100000:2.0:1787430711.039444:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:2.0:1787430711.039454:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6148:x1874256836168960:12345-192.168.202.25@tcp:33: 00000100:00100000:3.0:1787430711.039702:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430711.039717:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847743744:0@lo:41: 00000100:00100000:3.0:1787430711.039761:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430711.039811:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847743744 00000100:00100000:3.0:1787430711.039815:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847743744 00000100:00100000:3.0:1787430711.039842:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430711.039848:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847743744:12345-0@lo:41: 00000004:00000024:3.0:1787430711.039874:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787430711.039925:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847743744:12345-0@lo:41: Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430711.039939:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430711.039993:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847743744:0@lo:41: 00000100:00100000:0.0:1787430711.040087:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430711.040096:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847743872:0@lo:13: 00000100:00100000:0.0:1787430711.040121:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430711.040146:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847743872 00000100:00100000:0.0:1787430711.040149:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847743872 00000100:00100000:0.0:1787430711.040426:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430711.040436:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847743872:12345-0@lo:13: 00002000:00000024:0.0:1787430711.040449:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430711.040482:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847743872:12345-0@lo:13: Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430711.040488:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787430711.040520:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03490e00 x1874256847743872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430711.040546:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847743872:0@lo:13: 00000100:00080000:2.0:1787430711.040786:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430711.040869:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847744000:0@lo:13: 00000100:00100000:0.0:1787430711.041031:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430711.041093:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744000 00000100:00100000:2.0:1787430711.041098:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744000 00000100:00100000:2.0:1787430711.041131:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787430711.041138:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847744000:12345-0@lo:13: 00002000:00000024:2.0:1787430711.041150:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787430711.041220:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430711.041278:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847744000:12345-0@lo:13: Request processed in 140us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430711.041294:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787430711.041346:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3f86f100 x1874256847744000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430711.041359:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847744000:0@lo:13: 00000004:00080000:2.0:1787430711.052036:0:6500:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12455us 00000004:00200000:0.0:1787430711.058503:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787430711.058714:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6148:x1874256836168960:12345-192.168.202.25@tcp:33: Request processed in 19246us (19428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430711.058728:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:1.0:1787430711.195970:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430711.196321:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169088 00000100:00100000:0.0:1787430711.196331:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169088 00000100:00100000:0.0:1787430711.196393:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1787430711.196404:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6191:x1874256836169088:12345-192.168.202.25@tcp:101: 00010000:00010000:0.0:1787430711.196425:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430711.196487:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a93fa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138763 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430711.196558:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1ce00/0x4dbb683ba6a93fa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430711.196572:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1ce00/0x4dbb683ba6a93fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430711.196591:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1ce00/0x4dbb683ba6a93fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430711.196686:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430711.196689:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430711.196705:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1ce00/0x4dbb683ba6a93fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430711.196728:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a93fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138763 expref: 8 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430711.196757:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1ce00/0x4dbb683ba6a93fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138763 expref: 7 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430711.196766:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b32500) 00010000:00010000:0.0:1787430711.196769:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430711.196773:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1ce00, rc 0) 00000100:00100000:0.0:1787430711.196832:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:6191:x1874256836169088:12345-192.168.202.25@tcp:101: Request processed in 430us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430711.196839:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00010000:00010000:2.0:1787430711.295972:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430712.319775:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430712.886781:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430712.888432:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169216 00000100:00100000:0.0:1787430712.888445:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169216 00000100:00100000:0.0:1787430712.888516:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:0.0:1787430712.888526:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:6243:x1874256836169216:12345-192.168.202.25@tcp:41: 00000004:00000024:0.0:1787430712.889327:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787430712.889411:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:6243:x1874256836169216:12345-192.168.202.25@tcp:41: Request processed in 879us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430712.889420:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:1.0:1787430712.893146:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430712.893874:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169344 00000100:00100000:0.0:1787430712.893899:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169344 00000100:00100000:0.0:1787430712.894012:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1787430712.894139:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6243:x1874256836169344:12345-192.168.202.25@tcp:41: 00000004:00000024:0.0:1787430712.894178:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787430712.894347:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6243:x1874256836169344:12345-192.168.202.25@tcp:41: Request processed in 326us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430712.894355:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1787430712.897720:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430712.898850:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169472 00000100:00100000:3.0:1787430712.898862:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169472 00000100:00100000:3.0:1787430712.899009:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:3.0:1787430712.899030:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f903800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6243:x1874256836169472:12345-192.168.202.25@tcp:13: 00002000:00000024:3.0:1787430712.899063:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430712.899127:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f903800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6243:x1874256836169472:12345-192.168.202.25@tcp:13: Request processed in 109us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430712.899134:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:1.0:1787430712.900590:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430712.900685:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169600 00000100:00100000:3.0:1787430712.900692:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169600 00000100:00080000:2.0:1787430712.900750:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430712.900754:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430712.901223:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:3.0:1787430712.901235:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6243:x1874256836169600:12345-192.168.202.25@tcp:13: 00002000:00000024:3.0:1787430712.901282:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430712.901343:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:6243:x1874256836169600:12345-192.168.202.25@tcp:13: Request processed in 106us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430712.901351:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00010000:00010000:2.0:1787430713.343947:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430713.600411:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430713.600432:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847744128:0@lo:41: 00000100:00100000:2.0:1787430713.600433:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847744256:0@lo:13: 00000100:00100000:0.0:1787430713.600928:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430713.600940:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847744384:0@lo:13: 00000100:00100000:1.0:1787430713.601130:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430713.601155:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430713.604081:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744128 00000100:00100000:2.0:1787430713.604099:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744128 00000100:00100000:2.0:1787430713.604165:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430713.604175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847744128:12345-0@lo:41: 00000004:00000024:2.0:1787430713.604216:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787430713.604618:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430713.604802:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744256 00000100:00100000:0.0:1787430713.604810:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744256 00000100:00100000:0.0:1787430713.604844:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744384 00000100:00100000:0.0:1787430713.604847:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744384 00000100:00100000:0.0:1787430713.604868:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430713.604877:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847744256:12345-0@lo:13: 00002000:00000024:0.0:1787430713.604893:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430713.604944:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847744256:12345-0@lo:13: Request processed in 68us (3791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430713.604952:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430713.604969:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430713.604976:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847744384:12345-0@lo:13: 00002000:00000024:0.0:1787430713.604986:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430713.605012:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847744384:12345-0@lo:13: Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430713.605018:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430713.605043:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847744896:0@lo:400: 00000100:00100000:0.0:1787430713.605084:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430713.605106:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847745408:0@lo:400: 00000100:00100000:0.0:1787430713.605133:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430713.605158:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787430713.605164:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847744768:0@lo:400: 00000100:00100000:0.0:1787430713.605189:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430713.605208:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847745280:0@lo:400: 00000100:00100000:0.0:1787430713.605233:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430713.605375:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745408 00000100:00100000:0.0:1787430713.605380:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745408 00000100:00100000:0.0:1787430713.605411:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745280 00000100:00100000:0.0:1787430713.605415:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745280 00000100:00100000:0.0:1787430713.605440:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430713.605449:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847745408:12345-0@lo:400: 00000100:00100000:1.0:1787430713.607685:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744768 00000100:00100000:1.0:1787430713.607696:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744768 00000100:00100000:1.0:1787430713.607730:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430713.607740:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847744768:12345-0@lo:400: 00000100:00100000:2.0:1787430713.608126:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847744128:12345-0@lo:41: Request processed in 3943us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430713.608139:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787430713.608182:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430713.608187:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430713.608200:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744896 00000100:00100000:2.0:1787430713.608204:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744896 00000100:00100000:2.0:1787430713.608240:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787430713.608254:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847744896:12345-0@lo:400: 00000100:00100000:3.0:1787430713.608568:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430713.608579:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847745280:12345-0@lo:400: 00000100:00100000:1.0:1787430713.612561:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847744768:12345-0@lo:400: Request processed in 4807us (7355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430713.612561:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847745408:12345-0@lo:400: Request processed in 7098us (7411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430713.612586:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430713.612587:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787430713.612626:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847745280:12345-0@lo:400: Request processed in 4048us (7390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430713.612636:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430713.612680:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847744512:0@lo:400: 00010000:00080000:1.0:1787430713.612700:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0b480 x1874256847744384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430713.612724:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847744384:0@lo:13: 00000100:00100000:3.0:1787430713.612749:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430713.612794:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847745024:0@lo:400: 00000100:00100000:0.0:1787430713.612795:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744512 00000100:00100000:0.0:1787430713.612801:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744512 00000100:00100000:3.0:1787430713.612820:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430713.612841:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787430713.612844:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847745536:0@lo:400: 00000100:00100000:0.0:1787430713.612851:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847744512:12345-0@lo:400: 00000100:00100000:1.0:1787430713.612861:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745024 00000100:00100000:1.0:1787430713.612867:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745024 00000100:00100000:3.0:1787430713.612868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430713.612892:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847744512:12345-0@lo:400: Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430713.612897:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847744512:0@lo:400: 00000100:00100000:0.0:1787430713.612900:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787430713.612909:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787430713.612911:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745536 00000100:00100000:3.0:1787430713.612917:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847744640:0@lo:400: 00000100:00100000:1.0:1787430713.612927:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745536 00000100:00100000:3.0:1787430713.612940:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430713.612953:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847744640 00000100:00100000:3.0:1787430713.612957:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847745152:0@lo:400: 00000100:00100000:1.0:1787430713.612958:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847744640 00000100:00100000:1.0:1787430713.612981:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430713.612986:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430713.612994:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847745024:12345-0@lo:400: 00000100:00100000:3.0:1787430713.613002:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847745664:0@lo:400: 00000100:00100000:3.0:1787430713.613026:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787430713.613068:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a63a680 x1874256847744256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430713.613069:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847745024:12345-0@lo:400: Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430713.613086:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430713.613095:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847744256:0@lo:13: 00000100:00100000:1.0:1787430713.613103:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745152 00000100:00100000:1.0:1787430713.613108:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745152 00000100:00100000:0.0:1787430713.613123:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745664 00000100:00100000:0.0:1787430713.613129:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745664 00000100:00100000:1.0:1787430713.613132:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430713.613142:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847745536:12345-0@lo:400: 00000100:00100000:3.0:1787430713.613143:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787430713.613151:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787430713.613154:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787430713.613159:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430713.613173:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847744640:12345-0@lo:400: 00000100:00100000:3.0:1787430713.613179:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847744768:0@lo:400: 00010000:00080000:3.0:1787430713.613194:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b08a80 x1874256847745280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430713.613204:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847745280:0@lo:400: 00000100:00100000:1.0:1787430713.613213:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847745536:12345-0@lo:400: Request processed in 71us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430713.613216:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847744640:12345-0@lo:400: Request processed in 43us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430713.613228:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430713.613243:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430713.613269:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787430713.613276:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787430713.613282:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847745152:12345-0@lo:400: 00000100:00100000:0.0:1787430713.613289:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847745664:12345-0@lo:400: 00000100:00100000:1.0:1787430713.613335:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847745152:12345-0@lo:400: Request processed in 57us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430713.613337:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847745664:12345-0@lo:400: Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430713.613350:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787430713.613356:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787430713.613373:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430713.613379:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430713.613402:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847744640:0@lo:400: 00010000:00080000:1.0:1787430713.613419:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0a300 x1874256847745152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430713.613429:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847745152:0@lo:400: 00010000:00080000:1.0:1787430713.613445:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b09180 x1874256847745664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430713.613455:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847745664:0@lo:400: 00000100:00100000:1.0:1787430713.613470:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847745024:0@lo:400: 00000100:00100000:1.0:1787430713.613480:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847745536:0@lo:400: 00000100:00100000:2.0:1787430713.613695:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847744896:12345-0@lo:400: Request processed in 5447us (8608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430713.613702:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430713.615352:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847744896:0@lo:400: 00010000:00080000:3.0:1787430713.615374:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0b100 x1874256847745408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430713.615393:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847745408:0@lo:400: 00000100:00100000:3.0:1787430713.615414:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847744128:0@lo:41: 00010000:00010000:2.0:1787430714.367751:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430714.638577:0:10159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787430715.394058:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787430715.651647:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000001:00100000:0.0:1787430715.651766:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000001:00100000:1.0:1787430715.652923:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000100:00100000:1.0:1787430716.159861:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847745792:0@lo:41: 00000100:00100000:1.0:1787430716.159931:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.160032:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847745920:0@lo:13: 00000100:00100000:3.0:1787430716.160060:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430716.160082:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430716.160096:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847746048:0@lo:13: 00000100:00100000:0.0:1787430716.160477:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745792 00000100:00100000:0.0:1787430716.160485:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745792 00000100:00100000:0.0:1787430716.160581:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787430716.160593:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847745792:12345-0@lo:41: 00000004:00000024:0.0:1787430716.160642:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787430716.160695:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847745792:12345-0@lo:41: Request processed in 105us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.160702:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430716.160774:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847745792:0@lo:41: 00000100:00100000:3.0:1787430716.160869:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847745920 00000100:00100000:3.0:1787430716.160873:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847745920 00000100:00100000:3.0:1787430716.160906:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787430716.160912:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847745920:12345-0@lo:13: 00002000:00000024:3.0:1787430716.160930:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430716.160961:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847745920:12345-0@lo:13: Request processed in 49us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.160967:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787430716.160981:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787430716.160999:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c11579180 x1874256847745920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430716.161012:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847745920:0@lo:13: 00000100:00100000:1.0:1787430716.161079:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.161158:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847746048 00000100:00100000:3.0:1787430716.161162:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847746048 00000100:00100000:3.0:1787430716.161199:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430716.161205:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847746048:12345-0@lo:13: 00002000:00000024:3.0:1787430716.161214:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430716.161272:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847746048:12345-0@lo:13: Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.161278:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787430716.161320:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a63a680 x1874256847746048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430716.161331:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847746048:0@lo:13: 00000100:00080000:1.0:1787430716.161387:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430716.420661:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430716.420743:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430716.420785:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430716.420813:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430716.420835:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430716.420916:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430716.420946:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169856 00000100:00100000:0.0:1787430716.420955:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169856 00000100:00100000:0.0:1787430716.421016:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169984 00000100:00100000:0.0:1787430716.421026:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169984 00000100:00100000:0.0:1787430716.421060:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:0.0:1787430716.421071:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836169856:12345-192.168.202.25@tcp:400: 00000100:00080000:2.0:1787430716.421143:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430716.421149:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836169856:12345-192.168.202.25@tcp:400: Request processed in 77us (360us total) trans 0 rc 0/0 00000100:00080000:2.0:1787430716.421150:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430716.421161:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:2.0:1787430716.421164:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836170112 00000100:00100000:2.0:1787430716.421169:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836170112 00000100:00100000:0.0:1787430716.421182:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:0.0:1787430716.421192:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836169984:12345-192.168.202.25@tcp:400: 00000100:00100000:2.0:1787430716.421208:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836170240 00000100:00100000:2.0:1787430716.421218:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836170240 00000100:00100000:0.0:1787430716.421249:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836169984:12345-192.168.202.25@tcp:400: Request processed in 58us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.421257:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:2.0:1787430716.421262:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:2.0:1787430716.421272:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2402:x1874256836170112:12345-192.168.202.25@tcp:400: 00000100:00100000:2.0:1787430716.421305:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2402:x1874256836170112:12345-192.168.202.25@tcp:400: Request processed in 35us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430716.421313:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1787430716.421363:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1787430716.421371:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836170240:12345-192.168.202.25@tcp:400: 00000100:00100000:0.0:1787430716.421401:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836170240:12345-192.168.202.25@tcp:400: Request processed in 31us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.421408:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:3.0:1787430716.421888:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836169728 00000100:00100000:3.0:1787430716.421893:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836169728 00000100:00100000:3.0:1787430716.421952:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:3.0:1787430716.421958:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2401:x1874256836169728:12345-192.168.202.25@tcp:400: 00000100:00100000:3.0:1787430716.421982:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2401:x1874256836169728:12345-192.168.202.25@tcp:400: Request processed in 26us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.421986:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00080000:3.0:1787430716.422757:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430716.422761:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787430716.668077:0:10306:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8ce7e670 20000000:00000080:1.0:1787430716.668100:0:10306:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2c3f864c00 uarg=0000000000000000 20000000:01000000:1.0:1787430716.668138:0:10306:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787430716.668141:0:10306:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787430716.668144:0:10306:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787430716.668148:0:10306:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787430716.668153:0:10306:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787430716.668209:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787430716.668212:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787430716.668627:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1787430716.668787:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1787430716.668817:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1787430716.668834:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1787430716.668843:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787430716.668844:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787430716.669029:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1787430716.669263:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1787430716.669288:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1787430716.669304:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1787430716.669314:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787430716.669316:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787430716.669570:0:10309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787430716.669665:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787430716.669684:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787430716.669698:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1787430716.669708:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787430716.669709:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787430716.669942:0:10310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1787430716.670022:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1787430716.670044:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1787430716.670059:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1787430716.670068:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787430716.670069:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787430716.672348:0:10311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787430716.672512:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787430716.672540:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787430716.672554:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1787430716.672568:0:10306:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787430716.672587:0:10306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672634:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672643:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672651:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672658:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672665:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672686:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672693:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672702:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672710:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672720:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672728:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672736:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672781:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672796:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 9 pid: 6491 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.672811:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746176:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430716.672921:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.672939:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 9 pid: 6492 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.672950:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746304:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430716.672997:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673008:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 23 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.673020:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746432:0@lo:104: 00000100:00100000:2.0:1787430716.673059:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430716.673095:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673103:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 23 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.673111:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746560:0@lo:104: 00000100:00100000:2.0:1787430716.673132:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430716.673155:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673164:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 23 pid: 6491 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.673173:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746688:0@lo:104: 00000100:00100000:0.0:1787430716.673182:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847746432 00000100:00100000:0.0:1787430716.673190:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847746432 00000100:00100000:2.0:1787430716.673194:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430716.673224:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847746560 00000100:00100000:0.0:1787430716.673228:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847746560 00010000:00010000:2.0:1787430716.673242:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673253:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.673254:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847746688 00000100:00100000:0.0:1787430716.673259:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847746688 00000100:00100000:2.0:1787430716.673268:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746816:0@lo:104: 00000100:00100000:0.0:1787430716.673280:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787430716.673292:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:10306:x1874256847746432:12345-0@lo:104: 00000100:00100000:2.0:1787430716.673300:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430716.673310:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673323:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.673336:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787430716.673351:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.673352:0:6480:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787430716.673362:0:6480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787430716.673367:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746944:0@lo:104: 00010000:00010000:0.0:1787430716.673377:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430716.673385:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:10306:x1874256847746432:12345-0@lo:104: Request processed in 95us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430716.673398:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430716.673398:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787430716.673420:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847746816 00010000:00010000:2.0:1787430716.673424:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.673425:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847746816 00010000:00010000:2.0:1787430716.673437:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.673443:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847746944 00000100:00100000:0.0:1787430716.673447:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847746944 00000100:00100000:2.0:1787430716.673448:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747072:0@lo:104: 00000100:00100000:0.0:1787430716.673472:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430716.673482:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:10306:x1874256847746560:12345-0@lo:104: 00000100:00100000:2.0:1787430716.673489:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430716.673493:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673515:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673525:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 23 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.673535:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747200:0@lo:104: 00010000:00010000:0.0:1787430716.673535:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787430716.673545:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:10306:x1874256847746560:12345-0@lo:104: Request processed in 64us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.673553:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787430716.673567:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430716.673568:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747072 00000100:00100000:0.0:1787430716.673574:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747072 00010000:00010000:2.0:1787430716.673587:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.673591:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747200 00000100:00100000:0.0:1787430716.673596:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747200 00010000:00010000:2.0:1787430716.673623:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.673635:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747328:0@lo:104: 00000100:00100000:0.0:1787430716.673651:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787430716.673661:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430716.673663:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+7:10306:x1874256847746688:12345-0@lo:104: 00010000:00010000:0.0:1787430716.673672:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673689:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.673700:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 23 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.673706:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787430716.673710:0:10306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747456:0@lo:104: 00000100:00100000:0.0:1787430716.673716:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+7:10306:x1874256847746688:12345-0@lo:104: Request processed in 56us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.673731:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787430716.673738:0:10306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430716.673748:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747328 00000100:00100000:2.0:1787430716.673753:0:10306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430716.673753:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747328 00000100:00100000:0.0:1787430716.673771:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747456 00000100:00100000:2.0:1787430716.673776:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746432:0@lo:104: 00000100:00100000:0.0:1787430716.673776:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747456 00000100:00100000:2.0:1787430716.673790:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746560:0@lo:104: 00000100:00100000:0.0:1787430716.673796:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787430716.673800:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746688:0@lo:104: 00000100:00100000:0.0:1787430716.673807:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c360cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+8:10306:x1874256847746816:12345-0@lo:104: 00010000:00010000:0.0:1787430716.673816:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787430716.673861:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00010000:00010000:0.0:1787430716.673875:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787430716.673881:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c360cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+8:10306:x1874256847746816:12345-0@lo:104: Request processed in 79us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.673888:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430716.673917:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430716.673923:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+7:10306:x1874256847746944:12345-0@lo:104: 00010000:00010000:0.0:1787430716.673931:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.673956:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787430716.673961:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+7:10306:x1874256847746944:12345-0@lo:104: Request processed in 39us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.673967:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787430716.673975:0:10312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430716.673980:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430716.673981:0:10312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:10306:x1874256847747072:12345-0@lo:104: 00000100:00100000:0.0:1787430716.673985:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:10306:x1874256847747200:12345-0@lo:104: 00010000:00010000:3.0:1787430716.673988:0:10312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.673990:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430716.674016:0:10312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:0.0:1787430716.674020:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787430716.674021:0:10312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:10306:x1874256847747072:12345-0@lo:104: Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.674024:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:10306:x1874256847747200:12345-0@lo:104: Request processed in 40us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.674027:0:10312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430716.674030:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430716.674039:0:10312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787430716.674045:0:10312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10306:x1874256847747328:12345-0@lo:104: 00000100:00100000:1.0:1787430716.674087:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746816:0@lo:104: 00000100:00100000:1.0:1787430716.674096:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746944:0@lo:104: 00000100:00100000:1.0:1787430716.674102:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747072:0@lo:104: 00000100:00100000:1.0:1787430716.674118:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747200:0@lo:104: 00000100:00100000:0.0:1787430716.674152:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787430716.674197:0:10312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.674198:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10306:x1874256847747456:12345-0@lo:104: 00010000:00010000:0.0:1787430716.674205:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430716.674249:0:10312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00010000:00010000:0.0:1787430716.674249:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1787430716.674255:0:10312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10306:x1874256847747328:12345-0@lo:104: Request processed in 210us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.674255:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10306:x1874256847747456:12345-0@lo:104: Request processed in 97us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.674262:0:10312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430716.674270:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787430716.674287:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1787430716.674293:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430716.674297:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747328:0@lo:104: 00010000:00010000:0.0:1787430716.674300:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d800 already unused, calling callback (ffffffffc144ec20) 00000100:00100000:1.0:1787430716.674304:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847747456:0@lo:104: 10000000:00010000:0.0:1787430716.674305:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.674313:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430716.674321:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.674327:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430716.674750:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.674757:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.674779:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.674785:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1d800/0x4dbb683ba6a93f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.674795:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1787430716.674798:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.674804:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.674807:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.674813:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430716.674819:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.674824:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787430716.674881:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847747584:0@lo:103: 00000100:00100000:3.0:1787430716.674918:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.675769:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430716.675841:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00010000:00010000:0.0:1787430716.676422:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676434:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.676459:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.676476:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747584 00010000:00010000:0.0:1787430716.676479:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42174c00/0x4dbb683ba6a93f29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.676485:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747584 00010000:00010000:0.0:1787430716.676496:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787430716.676501:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.676520:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676529:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.676534:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676543:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430716.676550:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.676556:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787430716.676557:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836170368 00000100:00100000:2.0:1787430716.676562:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836170368 00000100:00100000:1.0:1787430716.676564:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746176:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430716.676585:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.676588:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 10 pid: 6491 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430716.676595:0:10306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1874256847746304:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430716.676618:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.676626:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676635:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175800/0x4dbb683ba6a93f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.676637:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836170496 00000100:00100000:2.0:1787430716.676643:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836170496 00010000:00010000:0.0:1787430716.676652:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787430716.676661:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 11 pid: 6492 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676663:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.676676:0:10306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676678:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.676684:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.676688:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787430716.676699:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.676703:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11443050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847747584:12345-0@lo:103: 10000000:00010000:0.0:1787430716.676714:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.676720:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:0.0:1787430716.676720:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430716.676729:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.676740:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676749:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.676756:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a93f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93f53 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676759:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.676778:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676786:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a93ee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93eea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676796:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787430716.676799:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676805:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efa00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.676808:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676824:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430716.676830:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.676836:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430716.676846:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430716.676859:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676867:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.676874:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676882:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360efa00/0x4dbb683ba6a93ec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ece expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.676893:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11443050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3628:x1874256847747584:12345-0@lo:103: Request processed in 193us (1974us total) trans 0 rc 0/0 00010000:00010000:0.0:1787430716.676893:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1787430716.676901:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787430716.676945:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:2.0:1787430716.676953:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:2400:x1874256836170368:12345-192.168.202.25@tcp:103: 00010000:00010000:2.0:1787430716.676961:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430716.676965:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 11 pid: 6491 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.676984:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 11 pid: 6491 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676988:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.676996:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a93f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386fa expref: 11 pid: 6491 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.676999:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.677005:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677009:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430716.677016:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430716.677023:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.677035:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787430716.677046:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2400:x1874256836170368:12345-192.168.202.25@tcp:103: Request processed in 94us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430716.677053:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00010000:00010000:0.0:1787430716.677065:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.677072:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00010000:00010000:0.0:1787430716.677079:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787430716.677083:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:2399:x1874256836170496:12345-192.168.202.25@tcp:103: 00010000:00010000:0.0:1787430716.677085:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677094:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430716.677095:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee600/0x4dbb683ba6a93eb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93ec0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677103:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 9 pid: 6492 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677112:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787430716.677120:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 9 pid: 6492 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677120:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677137:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.677140:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677142:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a93f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91386f3 expref: 9 pid: 6492 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677156:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677160:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:0.0:1787430716.677167:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.677173:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787430716.677185:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:2399:x1874256836170496:12345-192.168.202.25@tcp:103: Request processed in 103us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430716.677194:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00010000:00010000:0.0:1787430716.677195:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677203:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.677216:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677223:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a93eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93eb2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677264:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430716.677268:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677274:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1c600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.677277:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677283:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430716.677289:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.677296:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430716.677316:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677323:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.677328:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677334:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c600/0x4dbb683ba6a93e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e73 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677344:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430716.677353:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677359:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430716.677362:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677369:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430716.677375:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430716.677380:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430716.677404:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677410:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430716.677415:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677422:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b600/0x4dbb683ba6a93e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e49 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.677435:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430716.677438:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430716.677440:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430716.677450:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430716.677472:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847747712:0@lo:103: 00000100:00100000:0.0:1787430716.677509:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430716.677542:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847748224:0@lo:103: 00000100:00100000:2.0:1787430716.677549:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747712 00000100:00100000:2.0:1787430716.677561:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747712 00000100:00100000:0.0:1787430716.677577:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430716.677580:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 23 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.677640:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748224 00000100:00100000:3.0:1787430716.677646:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748224 00000100:00100000:2.0:1787430716.677651:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787430716.677661:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847747712:12345-0@lo:103: 00010000:00010000:3.0:1787430716.677670:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 24 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677670:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430716.677678:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677690:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.677703:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a93f30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93f29 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.677704:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787430716.677718:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430716.677720:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3629:x1874256847748224:12345-0@lo:103: 00010000:00010000:3.0:1787430716.677730:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430716.677735:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430716.677744:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.677751:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3629:x1874256847747712:12345-0@lo:103: Request processed in 91us (240us total) trans 0 rc 0/0 00010000:00010000:3.0:1787430716.677758:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a93ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93eb9 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.677760:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787430716.677773:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430716.677797:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3629:x1874256847748224:12345-0@lo:103: Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.677810:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430716.678063:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847748224:0@lo:103: 00000100:00100000:0.0:1787430716.678081:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847747712:0@lo:103: 00000100:00100000:0.0:1787430716.678089:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787430716.678094:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847747840:0@lo:103: 00000100:00100000:0.0:1787430716.678115:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430716.678134:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847748352:0@lo:103: 00000100:00100000:0.0:1787430716.678151:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430716.678179:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747840 00000100:00100000:2.0:1787430716.678184:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747840 00010000:00010000:2.0:1787430716.678199:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 21 pid: 6491 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.678220:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748352 00000100:00100000:2.0:1787430716.678224:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748352 00010000:00010000:2.0:1787430716.678249:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 22 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.678264:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847747968:0@lo:103: 00000100:00100000:2.0:1787430716.678265:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787430716.678281:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3629:x1874256847747840:12345-0@lo:103: 00010000:00010000:2.0:1787430716.678290:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430716.678295:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 22 pid: 6491 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.678302:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430716.678313:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 22 pid: 6491 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.678319:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847748480:0@lo:103: 00010000:00010000:2.0:1787430716.678341:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a93f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93f0d expref: 22 pid: 6491 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.678342:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430716.678356:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430716.678359:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787430716.678366:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847748096:0@lo:103: 00000100:00100000:2.0:1787430716.678396:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3629:x1874256847747840:12345-0@lo:103: Request processed in 117us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.678399:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430716.678408:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430716.678418:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847748608:0@lo:103: 00000100:00100000:2.0:1787430716.678423:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847747968 00000100:00100000:2.0:1787430716.678427:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847747968 00010000:00010000:2.0:1787430716.678441:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 21 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.678454:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748480 00000100:00100000:0.0:1787430716.678456:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430716.678458:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748480 00010000:00010000:2.0:1787430716.678474:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 22 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.678487:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748096 00000100:00100000:2.0:1787430716.678488:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748608 00000100:00100000:0.0:1787430716.678492:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748096 00000100:00100000:2.0:1787430716.678493:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748608 00010000:00010000:2.0:1787430716.678510:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430716.678518:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1787430716.678520:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 24 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430716.678532:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847748352:12345-0@lo:103: 00010000:00010000:1.0:1787430716.678541:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430716.678555:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.678566:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.678579:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1de00/0x4dbb683ba6a93eb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93eab expref: 24 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.678584:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787430716.678592:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430716.678599:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11442450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3627:x1874256847747968:12345-0@lo:103: 00010000:00010000:2.0:1787430716.678638:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430716.678644:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.678650:0:9495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1787430716.678654:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.678661:0:9495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1787430716.678668:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a93eea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93ee3 expref: 23 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.678677:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430716.678769:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787430716.678777:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430716.678784:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3627:x1874256847748480:12345-0@lo:103: 00010000:00010000:0.0:1787430716.678799:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430716.678803:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 22 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.678812:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 22 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.678821:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42174600/0x4dbb683ba6a93e73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93e6c expref: 22 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430716.678830:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430716.679201:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3629:x1874256847748352:12345-0@lo:103: Request processed in 673us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430716.679210:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430716.679222:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11442450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3627:x1874256847747968:12345-0@lo:103: Request processed in 623us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.679224:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3627:x1874256847748480:12345-0@lo:103: Request processed in 438us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430716.679240:0:6481:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787430716.679245:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787430716.679255:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787430716.679265:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3627:x1874256847748608:12345-0@lo:103: 00000100:00100000:3.0:1787430716.679280:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847747968:0@lo:103: 00010000:00010000:1.0:1787430716.679281:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787430716.679289:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:1.0:1787430716.679291:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 19 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.679296:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847748480:0@lo:103: 00000100:00100000:2.0:1787430716.679300:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430716.679310:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3627:x1874256847748096:12345-0@lo:103: 00010000:00010000:2.0:1787430716.679319:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430716.679324:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 19 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430716.679344:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430716.679375:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847747584:0@lo:103: 00010000:00010000:2.0:1787430716.679393:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 18 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.679404:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a93ece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93ec7 expref: 18 pid: 6492 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.679413:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430716.679445:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:3627:x1874256847748096:12345-0@lo:103: Request processed in 137us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430716.679457:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430716.679488:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847747840:0@lo:103: 00010000:00010000:1.0:1787430716.679489:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 16 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430716.679503:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847748352:0@lo:103: 00010000:00010000:1.0:1787430716.679511:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42174800/0x4dbb683ba6a93e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93e42 expref: 16 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430716.679524:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847748096:0@lo:103: 00010000:00010000:1.0:1787430716.679526:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679537:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679561:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679569:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679574:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679580:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679585:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430716.679589:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679625:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679653:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.679666:0:10306:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430716.679673:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430716.679677:0:10306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430716.679686:0:10306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f02600/0x4dbb683ba6a93fae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430716.679712:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:3627:x1874256847748608:12345-0@lo:103: Request processed in 449us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430716.679721:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430716.679825:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847748608:0@lo:103: 00010000:00010000:0.0:1787430717.444736:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787430717.759841:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787430717.759849:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c363a8000 from 48 10000000:01000000:1.0:1787430717.759854:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787430717.760015:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.760029:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.760040:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.760064:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847748736:0@lo:101: 00000100:00100000:1.0:1787430717.760134:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430717.760335:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748736 00000100:00100000:0.0:1787430717.760343:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748736 00000100:00100000:0.0:1787430717.760395:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787430717.760405:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+15:6494:x1874256847748736:12345-0@lo:101: 00010000:00010000:0.0:1787430717.760419:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787430717.760653:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021739c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787430717.761577:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1c200/0x4dbb683ba6a93fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93fb5 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.761619:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1c200/0x4dbb683ba6a93fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fb5 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.761630:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1c200/0x4dbb683ba6a93fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fb5 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.761657:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1c200, rc 0) 00000100:00100000:0.0:1787430717.761785:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847748736:12345-0@lo:101: Request processed in 1380us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.761792:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787430717.762050:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847748736:0@lo:101: 00010000:00010000:1.0:1787430717.762065:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.762085:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.762325:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847748864:0@lo:501: 00000100:00100000:1.0:1787430717.762356:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.762388:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.762544:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748864 00000100:00100000:0.0:1787430717.762550:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748864 00000100:00100000:0.0:1787430717.762581:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787430717.762588:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847748864:12345-0@lo:501: 00000100:00100000:0.0:1787430717.762726:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847748864:12345-0@lo:501: Request processed in 137us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.762733:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787430717.762799:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847748864:0@lo:501: 00000100:00100000:1.0:1787430717.762823:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847748992:0@lo:503: 00000100:00100000:1.0:1787430717.762861:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.762882:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.763587:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847748992 00000100:00100000:0.0:1787430717.763594:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847748992 00000100:00100000:0.0:1787430717.763654:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787430717.763661:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847748992:12345-0@lo:503: 00000100:00100000:0.0:1787430717.763757:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847748992:12345-0@lo:503: Request processed in 97us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.763763:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787430717.764376:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847748992:0@lo:503: 00000100:00100000:3.0:1787430717.764794:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10326:1874256847749120:0@lo:502: 00000100:00100000:3.0:1787430717.764841:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.765059:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.765285:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847749120 00000100:00100000:0.0:1787430717.765291:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847749120 00000100:00100000:0.0:1787430717.765370:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787430717.765380:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:10326:x1874256847749120:12345-0@lo:502: 00000100:00100000:0.0:1787430717.765496:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:10326:x1874256847749120:12345-0@lo:502: Request processed in 117us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.765504:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787430717.765580:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10326:1874256847749120:0@lo:502: 00000100:00100000:3.0:1787430717.765645:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10326:1874256847749248:0@lo:502: 00000100:00100000:3.0:1787430717.765677:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.766094:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.766198:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847749248 00000100:00100000:1.0:1787430717.766211:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847749248 00000100:00100000:1.0:1787430717.766245:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787430717.766252:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:10326:x1874256847749248:12345-0@lo:502: 00000100:00100000:1.0:1787430717.766338:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:10326:x1874256847749248:12345-0@lo:502: Request processed in 85us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.766346:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787430717.766482:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10326:1874256847749248:0@lo:502: 00000040:00080000:3.0:1787430717.766502:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787430717.766693:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787430717.766710:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430717.766718:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.766729:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430717.766750:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787430717.766752:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787430717.766755:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787430717.766778:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.767058:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.767068:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.767082:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847749376:0@lo:101: 00000100:00100000:1.0:1787430717.767111:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.767141:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430717.767186:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847749376 00000100:00100000:3.0:1787430717.767190:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847749376 00000100:00100000:3.0:1787430717.767229:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787430717.767236:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+16:6494:x1874256847749376:12345-0@lo:101: 00010000:00010000:3.0:1787430717.767245:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430717.767256:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a93fca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93fc3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.767284:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a93fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fc3 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.767293:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a93fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fc3 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.767302:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ba00, rc 0) 00000100:00100000:3.0:1787430717.767336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847749376:12345-0@lo:101: Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.767343:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787430717.767454:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847749376:0@lo:101: 00010000:00010000:1.0:1787430717.767465:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.767474:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.767516:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847749504:0@lo:501: 00000100:00100000:1.0:1787430717.767538:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.767557:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430717.767595:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847749504 00000100:00100000:3.0:1787430717.767598:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847749504 00000100:00100000:3.0:1787430717.767644:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787430717.767649:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847749504:12345-0@lo:501: 00000100:00100000:3.0:1787430717.767730:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847749504:12345-0@lo:501: Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.767737:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787430717.767794:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847749504:0@lo:501: 00000100:00100000:1.0:1787430717.767814:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847749632:0@lo:503: 00000100:00100000:1.0:1787430717.767848:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.767877:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430717.768038:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847749632 00000100:00100000:3.0:1787430717.768042:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847749632 00000100:00100000:3.0:1787430717.768057:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787430717.768062:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847749632:12345-0@lo:503: 00000100:00100000:3.0:1787430717.768133:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847749632:12345-0@lo:503: Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.768139:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787430717.768372:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847749632:0@lo:503: 00000100:00100000:3.0:1787430717.768719:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10327:1874256847749760:0@lo:502: 00000100:00100000:3.0:1787430717.768750:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.768772:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.768805:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847749760 00000100:00100000:1.0:1787430717.768809:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847749760 00000100:00100000:1.0:1787430717.768822:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787430717.768826:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:10327:x1874256847749760:12345-0@lo:502: 00000100:00100000:1.0:1787430717.768903:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:10327:x1874256847749760:12345-0@lo:502: Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.769041:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10327:1874256847749760:0@lo:502: 00000020:01000000:3.0:1787430717.769057:0:10327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430717.769063:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430717.769065:0:10327:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787430717.769069:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787430717.769082:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10327:1874256847749888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.769102:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.769108:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.769134:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787430717.769153:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847749888 00000100:00100000:1.0:1787430717.769156:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847749888 00000100:00100000:1.0:1787430717.769165:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787430717.769168:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:10327:x1874256847749888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430717.769315:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:10327:x1874256847749888:12345-0@lo:502:llog_process_th.0 Request processed in 144us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.769321:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787430717.769379:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10327:1874256847749888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430717.769396:0:10327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430717.769401:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430717.769407:0:10327:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787430717.769410:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1787430717.769542:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787430717.769554:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787430717.769560:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.769567:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430717.769572:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787430717.769574:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c35f42000 from 48 10000000:01000000:1.0:1787430717.769580:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787430717.769595:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.769648:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.769656:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.769670:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.769693:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.769734:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430717.769759:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750016 00000100:00100000:3.0:1787430717.769762:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750016 00000100:00100000:3.0:1787430717.769783:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787430717.769789:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+17:6494:x1874256847750016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430717.769797:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430717.769808:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a93fd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93fd1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.769825:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a93fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fd1 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.769835:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a93fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fd1 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.769843:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b400, rc 0) 00000100:00100000:3.0:1787430717.769988:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847750016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.769993:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787430717.770028:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430717.770036:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.770042:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.770070:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.770085:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.770100:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.770124:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750144 00000100:00100000:2.0:1787430717.770129:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750144 00000100:00100000:2.0:1787430717.770157:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787430717.770163:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847750144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.770269:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847750144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.770276:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787430717.770299:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.770322:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.770353:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.770403:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.770427:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750272 00000100:00100000:2.0:1787430717.770432:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750272 00000100:00100000:2.0:1787430717.770455:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787430717.770461:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847750272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.770525:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847750272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.770532:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787430717.770623:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430717.770999:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10328:1874256847750400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.771029:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430717.771129:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.771159:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750400 00000100:00100000:2.0:1787430717.771163:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750400 00000100:00100000:2.0:1787430717.771215:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787430717.771365:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:10328:x1874256847750400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430717.771433:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:10328:x1874256847750400:12345-0@lo:502:llog_process_th.0 Request processed in 72us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.771440:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787430717.771502:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10328:1874256847750400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.771531:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10328:1874256847750528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.771556:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430717.771571:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750528 00000100:00100000:0.0:1787430717.771574:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750528 00000100:00100000:0.0:1787430717.771589:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787430717.771594:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:10328:x1874256847750528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.771664:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:10328:x1874256847750528:12345-0@lo:502:llog_process_th.0 Request processed in 69us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.771670:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787430717.771691:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c09121a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.771700:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10328:1874256847750528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787430717.771714:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787430717.771934:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787430717.771952:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787430717.771961:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.771971:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430717.771979:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787430717.771981:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787430717.771984:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787430717.772004:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.772013:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.772026:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430717.772041:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.772072:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.772096:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430717.773002:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750656 00000100:00100000:3.0:1787430717.773009:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750656 00000100:00100000:3.0:1787430717.773098:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787430717.773107:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+18:6494:x1874256847750656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430717.773118:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430717.773131:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a93fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93fdf expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.773151:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a93fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fdf expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.773160:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a93fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fdf expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.773168:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ae00, rc 0) 00000100:00100000:3.0:1787430717.773208:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847750656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.773215:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787430717.773503:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430717.773517:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.773526:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430717.773583:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.773628:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.773661:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.773688:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750784 00000100:00100000:0.0:1787430717.773693:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750784 00000100:00100000:0.0:1787430717.773713:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787430717.773720:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847750784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430717.773823:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847750784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.773830:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787430717.773845:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.773869:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.774001:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.774061:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.774094:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847750912 00000100:00100000:1.0:1787430717.774098:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847750912 00000100:00100000:1.0:1787430717.774128:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787430717.774135:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847750912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.774312:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847750912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.774319:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787430717.774410:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847750912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.774719:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10329:1874256847751040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430717.774747:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.774802:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.774830:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751040 00000100:00100000:0.0:1787430717.774834:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751040 00000100:00100000:0.0:1787430717.774998:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787430717.775006:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:10329:x1874256847751040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.775106:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:10329:x1874256847751040:12345-0@lo:502:llog_process_th.0 Request processed in 100us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.775112:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787430717.775170:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10329:1874256847751040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430717.775191:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430717.775199:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430717.775202:0:10329:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787430717.775270:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787430717.775288:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10329:1874256847751168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.775321:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.775380:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c132e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.775409:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751168 00000100:00100000:0.0:1787430717.775413:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751168 00000100:00100000:0.0:1787430717.775476:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787430717.775483:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:10329:x1874256847751168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.775548:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:10329:x1874256847751168:12345-0@lo:502:llog_process_th.0 Request processed in 65us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.775554:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787430717.775623:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10329:1874256847751168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430717.775638:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430717.775641:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430717.775643:0:10329:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787430717.775646:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787430717.775769:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787430717.775792:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787430717.775799:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.775809:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430717.775817:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787430717.775819:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c3a6a2800 from 48 10000000:01000000:2.0:1787430717.775821:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787430717.775845:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.775852:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.775859:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430717.775870:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.776010:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.776066:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.776120:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751296 00000100:00100000:0.0:1787430717.776125:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751296 00000100:00100000:0.0:1787430717.776144:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787430717.776151:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:6494:x1874256847751296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430717.776157:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430717.776169:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1d000/0x4dbb683ba6a93ff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93fed expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.776187:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1d000/0x4dbb683ba6a93ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fed expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.776196:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1d000/0x4dbb683ba6a93ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93fed expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.777415:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d000, rc 0) 00000100:00100000:0.0:1787430717.777541:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847751296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1389us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.777549:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787430717.778405:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430717.778427:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.778439:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430717.778513:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.778551:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.778592:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.778707:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751424 00000100:00100000:1.0:1787430717.778713:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751424 00000100:00100000:1.0:1787430717.778752:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787430717.778760:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847751424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.779088:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847751424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.779095:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787430717.779169:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.779196:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.779299:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.779324:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.779373:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751552 00000100:00100000:1.0:1787430717.779378:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751552 00000100:00100000:1.0:1787430717.779435:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787430717.779442:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847751552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.779518:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847751552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.779523:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787430717.779637:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.780144:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10330:1874256847751680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430717.780177:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.780373:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430717.780445:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751680 00000100:00100000:3.0:1787430717.780450:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751680 00000100:00100000:3.0:1787430717.780474:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787430717.780482:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:10330:x1874256847751680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.780576:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:10330:x1874256847751680:12345-0@lo:502:llog_process_th.0 Request processed in 94us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.780583:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787430717.780671:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10330:1874256847751680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430717.780707:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10330:1874256847751808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430717.780734:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.780757:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03b97d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430717.780802:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751808 00000100:00100000:3.0:1787430717.780806:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751808 00000100:00100000:3.0:1787430717.780823:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787430717.780829:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:10330:x1874256847751808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.780899:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:10330:x1874256847751808:12345-0@lo:502:llog_process_th.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.780914:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787430717.781070:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10330:1874256847751808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787430717.781087:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787430717.781331:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787430717.781356:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787430717.781365:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.781376:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430717.781396:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787430717.781399:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787430717.781402:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787430717.781424:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.781431:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.781440:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430717.781453:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.781479:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.781500:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.781540:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847751936 00000100:00100000:2.0:1787430717.781545:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847751936 00000100:00100000:2.0:1787430717.781565:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787430717.781571:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847751936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430717.781580:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430717.781591:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f02800/0x4dbb683ba6a94002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a93ffb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.781638:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f02800/0x4dbb683ba6a94002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ffb expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.781648:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f02800/0x4dbb683ba6a94002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93ffb expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.781657:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02800, rc 0) 00000100:00100000:2.0:1787430717.781688:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847751936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.781703:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787430717.781785:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847751936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430717.781795:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.781803:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430717.781842:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.781864:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.781892:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.782110:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752064 00000100:00100000:2.0:1787430717.782115:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752064 00000100:00100000:2.0:1787430717.782134:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787430717.782140:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847752064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.782250:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847752064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.782257:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787430717.782361:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.782385:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.782423:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.782444:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.782516:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752192 00000100:00100000:2.0:1787430717.782520:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752192 00000100:00100000:2.0:1787430717.782537:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787430717.782542:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847752192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.782632:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847752192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.782640:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787430717.782778:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.783152:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10331:1874256847752320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.783186:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.783231:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.783322:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752320 00000100:00100000:2.0:1787430717.783327:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752320 00000100:00100000:2.0:1787430717.783346:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787430717.783353:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10331:x1874256847752320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430717.783435:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10331:x1874256847752320:12345-0@lo:502:llog_process_th.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.783442:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787430717.783504:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10331:1874256847752320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430717.783525:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430717.783533:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430717.783535:0:10331:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787430717.783541:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787430717.783557:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10331:1874256847752448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.783586:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.783633:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1fc52540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.783681:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752448 00000100:00100000:2.0:1787430717.783685:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752448 00000100:00100000:2.0:1787430717.783700:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787430717.783705:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10331:x1874256847752448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430717.783923:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10331:x1874256847752448:12345-0@lo:502:llog_process_th.0 Request processed in 217us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.783930:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787430717.784127:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10331:1874256847752448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430717.784145:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430717.784149:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430717.784151:0:10331:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787430717.784154:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787430717.784358:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787430717.784374:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787430717.784382:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.784392:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430717.784401:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787430717.784404:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c04f2d000 from 48 10000000:01000000:2.0:1787430717.784407:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787430717.784428:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.784435:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430717.784444:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430717.784456:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.784483:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430717.784544:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aebcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.784574:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752576 00000100:00100000:1.0:1787430717.784578:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752576 00000100:00100000:1.0:1787430717.784751:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787430717.784776:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847752576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430717.784785:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430717.784797:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef800/0x4dbb683ba6a94010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a94009 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.784816:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef800/0x4dbb683ba6a94010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a94009 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.784827:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360ef800/0x4dbb683ba6a94010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a94009 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.784836:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef800, rc 0) 00000100:00100000:1.0:1787430717.785042:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847752576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.785048:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787430717.785115:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430717.785127:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.785135:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430717.785189:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.785290:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.785317:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1fc52540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.785356:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752704 00000100:00100000:0.0:1787430717.785361:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752704 00000100:00100000:0.0:1787430717.785395:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787430717.785402:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847752704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430717.785561:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847752704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.785569:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787430717.785831:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.785855:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.785887:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.785991:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1fc52540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430717.786016:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752832 00000100:00100000:2.0:1787430717.786020:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752832 00000100:00100000:2.0:1787430717.786070:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787430717.786083:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847752832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.786155:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847752832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430717.786162:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787430717.786232:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847752832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430717.786682:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10332:1874256847752960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.786717:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.786734:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1fc52c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.786786:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847752960 00000100:00100000:1.0:1787430717.786790:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847752960 00000100:00100000:1.0:1787430717.786817:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787430717.786825:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10332:x1874256847752960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430717.787022:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10332:x1874256847752960:12345-0@lo:502:llog_process_th.0 Request processed in 197us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.787029:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787430717.787105:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10332:1874256847752960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.787141:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10332:1874256847753088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430717.787171:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430717.787191:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1af33780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.787300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753088 00000100:00100000:1.0:1787430717.787304:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753088 00000100:00100000:1.0:1787430717.787322:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787430717.787327:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10332:x1874256847753088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430717.787393:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10332:x1874256847753088:12345-0@lo:502:llog_process_th.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.787404:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787430717.787472:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10332:1874256847753088:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787430717.787488:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787430717.787628:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787430717.787654:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430717.787662:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.787672:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430717.787681:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787430717.787684:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787430717.787687:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787430717.787706:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.787713:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.787721:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.787733:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.787759:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.787792:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.787970:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753216 00000100:00100000:0.0:1787430717.787974:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753216 00000100:00100000:0.0:1787430717.787996:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787430717.788003:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847753216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430717.788011:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430717.788022:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1ca00/0x4dbb683ba6a9401e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a94017 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.788040:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1ca00/0x4dbb683ba6a9401e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a94017 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.788050:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1ca00/0x4dbb683ba6a9401e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a94017 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.788058:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1ca00, rc 0) 00000100:00100000:0.0:1787430717.788093:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847753216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.788099:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787430717.788201:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430717.788304:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.788323:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430717.788371:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.788394:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.788417:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.788464:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753344 00000100:00100000:0.0:1787430717.788468:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753344 00000100:00100000:0.0:1787430717.788496:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787430717.788503:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847753344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430717.788596:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847753344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.788625:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787430717.788723:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.788748:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.788845:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.788870:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.788977:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753472 00000100:00100000:0.0:1787430717.788981:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753472 00000100:00100000:0.0:1787430717.789039:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787430717.789047:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847753472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430717.789124:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847753472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.789131:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787430717.789200:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.789670:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10333:1874256847753600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430717.789702:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.789719:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.789793:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753600 00000100:00100000:0.0:1787430717.789798:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753600 00000100:00100000:0.0:1787430717.789816:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787430717.789822:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10333:x1874256847753600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.789894:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10333:x1874256847753600:12345-0@lo:502:llog_process_th.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.789901:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787430717.790056:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10333:1874256847753600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787430717.790077:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430717.790085:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430717.790088:0:10333:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787430717.790109:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787430717.790129:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10333:1874256847753728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430717.790160:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430717.790174:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b021730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430717.790396:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753728 00000100:00100000:0.0:1787430717.790400:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753728 00000100:00100000:0.0:1787430717.790419:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787430717.790432:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10333:x1874256847753728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430717.790503:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10333:x1874256847753728:12345-0@lo:502:llog_process_th.0 Request processed in 71us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430717.790509:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787430717.790582:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10333:1874256847753728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787430717.790632:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430717.790636:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430717.790638:0:10333:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787430717.790642:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787430717.791001:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787430717.791017:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787430717.791026:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.791036:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430717.791046:0:6494:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787430717.791049:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e2c10964d28 from 1 10000000:01000000:0.0:1787430717.791052:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787430717.791074:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.791082:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.791091:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430717.791104:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430717.791132:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430717.791157:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a797240 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.791200:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753856 00000100:00100000:1.0:1787430717.791277:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753856 00000100:00100000:1.0:1787430717.791310:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787430717.791317:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847753856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430717.791326:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430717.791338:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a9402c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a94025 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.791358:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a9402c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a94025 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.791368:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a9402c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a94025 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.791377:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef400, rc 0) 00000100:00100000:1.0:1787430717.791415:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847753856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.791421:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787430717.791487:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430717.791506:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9402c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.791514:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9402c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430717.791556:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430717.791580:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430717.791628:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a797240 going to sleep for 11 seconds 00000100:00100000:1.0:1787430717.791677:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847753984 00000100:00100000:1.0:1787430717.791681:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847753984 00000100:00100000:1.0:1787430717.791698:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787430717.791703:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847753984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430717.791774:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847753984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (192us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430717.791788:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787430717.791896:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847753984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787430717.791978:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787430717.791984:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9402c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430717.791992:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9402c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430717.885807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430717.889671:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836170624 00000100:00100000:1.0:1787430717.889686:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836170624 00000100:00100000:1.0:1787430717.889762:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 235 00000100:00100000:1.0:1787430717.889773:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:6162:x1874256836170624:12345-192.168.202.25@tcp:101: 00010000:00010000:1.0:1787430717.889790:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430717.889817:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360ee600/0x4dbb683ba6a94033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913876a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.889845:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ee600/0x4dbb683ba6a94033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913876a expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.889856:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360ee600/0x4dbb683ba6a94033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913876a expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430717.889875:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ee600, rc 0) 00000100:00100000:1.0:1787430717.889944:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6162:x1874256836170624:12345-192.168.202.25@tcp:101: Request processed in 172us (4144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.889951:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 235 00000100:00100000:1.0:1787430717.894784:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430717.894882:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836170752 00000100:00100000:3.0:1787430717.894891:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836170752 00000100:00100000:3.0:1787430717.894935:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 236 00000100:00100000:3.0:1787430717.894943:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6162:x1874256836170752:12345-192.168.202.25@tcp:501: 00000100:00100000:3.0:1787430717.895101:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6162:x1874256836170752:12345-192.168.202.25@tcp:501: Request processed in 157us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.895110:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 236 00000100:00100000:0.0:1787430717.896585:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430717.896687:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836170880 00000100:00100000:3.0:1787430717.896695:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836170880 00000100:00100000:3.0:1787430717.896742:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 237 00000100:00100000:3.0:1787430717.896752:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6162:x1874256836170880:12345-192.168.202.25@tcp:503: 00000100:00100000:3.0:1787430717.896860:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6162:x1874256836170880:12345-192.168.202.25@tcp:503: Request processed in 109us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.896866:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 237 00000100:00100000:0.0:1787430717.900318:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430717.900490:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171008 00000100:00100000:3.0:1787430717.900499:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171008 00000100:00100000:3.0:1787430717.900589:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:3.0:1787430717.900597:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6643:x1874256836171008:12345-192.168.202.25@tcp:502: 00000100:00100000:3.0:1787430717.900882:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6643:x1874256836171008:12345-192.168.202.25@tcp:502: Request processed in 284us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.900891:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:0.0:1787430717.902697:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430717.903226:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171136 00000100:00100000:1.0:1787430717.903238:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171136 00000100:00100000:1.0:1787430717.903292:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:1.0:1787430717.903308:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6643:x1874256836171136:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430717.903460:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6643:x1874256836171136:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 153us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430717.903466:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:0.0:1787430717.906444:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430717.906920:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171264 00000100:00100000:3.0:1787430717.906929:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171264 00000100:00100000:3.0:1787430717.907038:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:3.0:1787430717.907051:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6162:x1874256836171264:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430717.907077:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430717.907095:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b200/0x4dbb683ba6a9403a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138771 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.907121:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b200/0x4dbb683ba6a9403a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138771 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.907148:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b200/0x4dbb683ba6a9403a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138771 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430717.907170:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b200, rc 0) 00000100:00100000:3.0:1787430717.907242:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171264:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 194us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430717.907249:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:0.0:1787430717.911952:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430717.912125:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171392 00000100:00100000:2.0:1787430717.912136:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171392 00000100:00100000:2.0:1787430717.913041:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:2.0:1787430717.913053:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171392:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430717.913185:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171392:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 134us (1242us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787430717.913194:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 241 00010000:00010000:0.0:1787430718.464273:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430718.721337:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847754240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430718.721404:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430718.721461:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847754240 00000100:00100000:2.0:1787430718.721468:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847754240 00000100:00100000:1.0:1787430718.721477:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430718.721486:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847754112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430718.721514:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430718.721523:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787430718.721537:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847754240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787430718.721568:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787430718.721640:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847754240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430718.721819:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787430718.721841:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847754368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430718.721884:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430718.721884:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847754496:0@lo:400:kworker.0 00000100:00100000:3.0:1787430718.721918:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847754880:0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.721926:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430718.721957:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430718.722179:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847754624:0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.722188:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847755008:0@lo:400:kworker.0 00000100:00100000:1.0:1787430718.722207:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847754112 00000100:00100000:1.0:1787430718.722223:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847754112 00000100:00100000:0.0:1787430718.722234:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430718.722260:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847755136:0@lo:400:kworker.0 00000100:00100000:1.0:1787430718.722261:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847754368 00000100:00100000:1.0:1787430718.722266:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847754368 00000100:00100000:1.0:1787430718.722293:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787430718.722301:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847754112:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430718.722316:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787430718.722325:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430718.722339:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847755648:0@lo:400:kworker.0 00000100:00100000:1.0:1787430718.722365:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847754112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430718.722373:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430718.722377:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787430718.722397:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847755392:0@lo:400:kworker.0 00000100:00100000:1.0:1787430718.722397:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430718.722401:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787430718.722406:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847754368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430718.722412:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847754752:0@lo:400:kworker.0 00002000:00000024:1.0:1787430718.722417:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430718.722428:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430718.729383:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430718.729455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430718.729459:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847754368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7050us (7574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430718.729472:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430718.729501:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847755264:0@lo:400:kworker.0 00010000:00080000:1.0:1787430718.729548:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd5880 x1874256847754112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430718.729556:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847755520:0@lo:400:kworker.0 00000100:00100000:1.0:1787430718.729576:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847754112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430718.729597:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430718.729616:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847754240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430718.729647:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430718.729668:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847754496 00000100:00100000:2.0:1787430718.729676:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847754496 00000100:00100000:2.0:1787430718.729717:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787430718.729726:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847754496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430718.729748:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847754880 00000100:00100000:0.0:1787430718.729754:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847754880 00000100:00100000:2.0:1787430718.729778:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847754496:12345-0@lo:400:kworker.0 Request processed in 53us (7851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430718.729782:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847754624 00000100:00100000:0.0:1787430718.729787:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847754624 00000100:00100000:2.0:1787430718.729789:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787430718.729805:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847755136 00000100:00100000:0.0:1787430718.729809:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847755136 00000100:00100000:0.0:1787430718.729828:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847755648 00000100:00100000:0.0:1787430718.729831:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847755648 00000100:00100000:0.0:1787430718.729844:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847755008 00000100:00100000:0.0:1787430718.729846:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847755008 00000100:00100000:0.0:1787430718.729856:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847755520 00000100:00100000:0.0:1787430718.729859:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847755520 00000100:00100000:0.0:1787430718.729873:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430718.729881:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847754880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.729921:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847754496:0@lo:400:kworker.0 00000100:00100000:1.0:1787430718.729923:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847755392 00000100:00100000:0.0:1787430718.729925:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847754880:12345-0@lo:400:kworker.0 Request processed in 43us (7966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430718.729935:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847755392 00000100:00100000:0.0:1787430718.729938:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430718.729959:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787430718.729968:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847754624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.729972:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787430718.729984:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847755136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430718.730018:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847754880:0@lo:400:kworker.0 00000100:00100000:0.0:1787430718.730019:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847754624:12345-0@lo:400:kworker.0 Request processed in 50us (7783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430718.730036:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787430718.730037:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847755136:12345-0@lo:400:kworker.0 Request processed in 53us (7718us total) trans 0 rc 0/0 00010000:00080000:3.0:1787430718.730042:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de5f80 x1874256847754368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430718.730050:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787430718.730065:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847754368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430718.730072:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787430718.730079:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847755648:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787430718.730099:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430718.730105:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430718.730106:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847755648:12345-0@lo:400:kworker.0 Request processed in 28us (7734us total) trans 0 rc 0/0 00000100:00080000:3.0:1787430718.730109:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430718.730113:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430718.730119:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787430718.730132:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430718.730139:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847755008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.730168:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847755008:12345-0@lo:400:kworker.0 Request processed in 30us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430718.730173:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430718.730185:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430718.730189:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847755008:0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.730191:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847755520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.730238:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847755520:12345-0@lo:400:kworker.0 Request processed in 48us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430718.730243:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787430718.730266:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847755264 00000100:00100000:2.0:1787430718.730268:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847754752 00000100:00100000:1.0:1787430718.730271:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847755264 00000100:00100000:2.0:1787430718.730273:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847754752 00000100:00100000:2.0:1787430718.730299:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430718.730305:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847754752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430718.730322:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430718.730334:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847755392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430718.730340:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847754752:12345-0@lo:400:kworker.0 Request processed in 35us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430718.730351:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430718.730393:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847755392:12345-0@lo:400:kworker.0 Request processed in 62us (7963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430718.730397:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847755520:0@lo:400:kworker.0 00000100:00100000:3.0:1787430718.730404:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430718.730425:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430718.730434:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847755264:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787430718.730437:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03debb80 x1874256847755392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430718.730449:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847755392:0@lo:400:kworker.0 00000100:00100000:3.0:1787430718.730472:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847755264:12345-0@lo:400:kworker.0 Request processed in 40us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430718.730480:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787430718.730513:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430718.731473:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847754752:0@lo:400:kworker.0 00010000:00080000:1.0:1787430718.731487:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de8000 x1874256847755264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430718.731496:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847755264:0@lo:400:kworker.0 00000100:00100000:1.0:1787430718.731508:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847754624:0@lo:400:kworker.0 00010000:00080000:1.0:1787430718.731519:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03deb480 x1874256847755136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430718.731528:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847755136:0@lo:400:kworker.0 00010000:00080000:1.0:1787430718.731539:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de9500 x1874256847755648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430718.731547:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847755648:0@lo:400:kworker.0 00000020:00000080:2.0:1787430719.319324:0:10370:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff558c4b30 20000000:00000080:2.0:1787430719.319341:0:10370:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2b03ad3000 uarg=0000000000000000 20000000:01000000:2.0:1787430719.319380:0:10370:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787430719.319386:0:10370:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787430719.319390:0:10370:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787430719.319839:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787430719.319979:0:10370:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787430719.323032:0:10370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787430719.323067:0:10370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787430719.323084:0:10370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787430719.323098:0:10370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787430719.323115:0:10370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323133:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c01491400/0x4dbb683ba6a93c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323140:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323145:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323152:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323160:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323167:0:10370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323360:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323377:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 9 pid: 6491 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430719.323404:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847755776:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430719.323540:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323548:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 23 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430719.323558:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847755904:0@lo:104: 00000100:00100000:0.0:1787430719.323596:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430719.323663:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323671:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 23 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430719.323680:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847756032:0@lo:104: 00000100:00100000:0.0:1787430719.323701:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430719.323730:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787430719.323740:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847755904 00000100:00100000:0.0:1787430719.323745:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847755904 00000100:00100000:0.0:1787430719.323778:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756032 00000100:00100000:0.0:1787430719.323780:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756032 00000100:00100000:0.0:1787430719.323792:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430719.323800:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10370:x1874256847755904:12345-0@lo:104: 00010000:00010000:0.0:1787430719.323812:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323851:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430719.323863:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10370:x1874256847755904:12345-0@lo:104: Request processed in 63us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430719.323870:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430719.323886:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430719.323892:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36051050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:10370:x1874256847756032:12345-0@lo:104: 00010000:00010000:0.0:1787430719.323900:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323932:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787430719.323937:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36051050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:10370:x1874256847756032:12345-0@lo:104: Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430719.323943:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787430719.323982:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430719.323989:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.323995:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430719.323999:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.324006:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430719.324013:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430719.324018:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787430719.324040:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.324055:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430719.325445:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430719.325516:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.325529:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 23 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430719.325540:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847756288:0@lo:104: 00000100:00100000:1.0:1787430719.325584:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430719.325657:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c01491400/0x4dbb683ba6a93c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.325677:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c01491400/0x4dbb683ba6a93c89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 23 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430719.325685:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847756416:0@lo:104: 00000100:00100000:1.0:1787430719.325710:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430719.325725:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c86180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430719.325748:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847755904:0@lo:104: 00000100:00100000:1.0:1787430719.325758:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847756032:0@lo:104: 00000100:00100000:1.0:1787430719.325800:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756288 00000100:00100000:1.0:1787430719.325807:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756288 00000100:00100000:1.0:1787430719.325838:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756416 00000100:00100000:1.0:1787430719.325841:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756416 00000100:00100000:1.0:1787430719.325854:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430719.325861:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10370:x1874256847756288:12345-0@lo:104: 00010000:00010000:1.0:1787430719.325872:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.325911:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430719.325916:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:10370:x1874256847756288:12345-0@lo:104: Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430719.325923:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430719.325941:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430719.325947:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:10370:x1874256847756416:12345-0@lo:104: 00010000:00010000:1.0:1787430719.325955:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.325979:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430719.325990:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:10370:x1874256847756416:12345-0@lo:104: Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430719.325996:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430719.326020:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847756288:0@lo:104: 00000100:00100000:1.0:1787430719.326027:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847756416:0@lo:104: 00010000:00010000:3.0:1787430719.326416:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430719.326497:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326505:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430719.326509:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326517:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430719.326525:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430719.326529:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430719.326561:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326568:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430719.326590:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326596:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a93d38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93d3f expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326643:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430719.326653:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326658:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430719.326661:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326668:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430719.326673:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430719.326678:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430719.326691:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326696:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430719.326703:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326707:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c00030800/0x4dbb683ba6a93c82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93c89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326716:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430719.326719:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430719.326720:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430719.326732:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847756544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430719.326765:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430719.326797:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430719.326804:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847756672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430719.326832:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430719.326863:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756544 00000100:00100000:1.0:1787430719.326868:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756544 00010000:00010000:1.0:1787430719.326889:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 24 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430719.326907:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756672 00000100:00100000:1.0:1787430719.326910:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756672 00010000:00010000:1.0:1787430719.326922:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c01491400/0x4dbb683ba6a93c89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 25 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430719.326941:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430719.326948:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+25:3627:x1874256847756544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430719.326957:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430719.326962:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 25 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326971:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 25 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326984:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c013ea000/0x4dbb683ba6a93d3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93d38 expref: 25 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.326996:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430719.327021:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847756544:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430719.327027:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430719.327040:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430719.327045:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3627:x1874256847756672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430719.327060:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430719.327064:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c01491400/0x4dbb683ba6a93c89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 23 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.327073:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c01491400/0x4dbb683ba6a93c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 23 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.327082:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c01491400/0x4dbb683ba6a93c89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93c82 expref: 23 pid: 6491 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.327090:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430719.327107:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3627:x1874256847756672:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430719.327113:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430719.327142:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847756672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430719.327148:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847756544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430719.327647:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.327657:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a600/0x4dbb683ba6a93e5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93e65 expref: -99 pid: 9484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.327668:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430719.327669:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430719.327671:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430719.327715:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787430719.327726:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847756160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430719.327752:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430719.327844:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756160 00000100:00100000:0.0:1787430719.327849:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756160 00010000:00010000:0.0:1787430719.327870:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 22 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430719.327898:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787430719.327906:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3629:x1874256847756160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430719.327915:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430719.327919:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 22 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.327929:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 22 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.327940:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42175600/0x4dbb683ba6a93e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93e5e expref: 22 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430719.327950:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430719.327982:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3629:x1874256847756160:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430719.327996:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787430719.328025:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847756160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430719.328293:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430719.328295:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430719.328297:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430719.328322:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328330:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430719.328333:0:10372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328340:0:10372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430719.328346:0:10372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430719.328351:0:10372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787430719.328408:0:10372:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328416:0:10372:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430719.328441:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328455:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a93cd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a93cdd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328471:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430719.328473:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430719.328475:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430719.328511:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430719.328528:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847756800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430719.328559:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430719.328730:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756800 00000100:00100000:3.0:1787430719.328735:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756800 00010000:00010000:3.0:1787430719.328755:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 21 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430719.328786:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430719.328794:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11443c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3630:x1874256847756800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430719.328803:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430719.328807:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 21 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328815:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 21 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328825:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a93cdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a93cd6 expref: 21 pid: 6489 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430719.328834:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430719.328867:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11443c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3630:x1874256847756800:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430719.328873:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430719.328920:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847756800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430719.333559:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1874256847755776:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430719.333576:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00010000:00010000:1.0:1787430719.333596:0:10370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430719.333765:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171520 00000100:00100000:2.0:1787430719.333774:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171520 00010000:00010000:2.0:1787430719.333808:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 10 pid: 6491 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430719.333852:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:2.0:1787430719.333863:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2400:x1874256836171520:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430719.333877:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430719.333883:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 10 pid: 6491 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333896:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 10 pid: 6491 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333914:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a93f7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138732 expref: 10 pid: 6491 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333929:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333937:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333952:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333959:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333981:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333987:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.333992:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1dc00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430719.333996:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.334003:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.334020:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430719.334030:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430719.334039:0:10370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.334049:0:10370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430719.334057:0:10370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1dc00/0x4dbb683ba6a94041 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430719.334125:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:2400:x1874256836171520:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 264us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430719.334131:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00010000:00010000:1.0:1787430719.487989:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430720.509523:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430720.509576:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171648 00000100:00100000:0.0:1787430720.509586:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171648 00000100:00100000:0.0:1787430720.509661:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 243 00000100:00100000:0.0:1787430720.509674:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:6162:x1874256836171648:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430720.509689:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430720.509709:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138778 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430720.509735:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430720.509747:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430720.509757:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1cc00, rc 0) 00000100:00100000:0.0:1787430720.509818:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171648:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 146us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430720.509825:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 243 00010000:00010000:0.0:1787430720.512224:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430720.518470:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430720.518524:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171776 00000100:00100000:3.0:1787430720.518535:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171776 00000100:00100000:3.0:1787430720.518681:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 244 00000100:00100000:3.0:1787430720.518695:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171776:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430720.518837:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171776:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 145us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430720.518846:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 244 00000100:00100000:3.0:1787430720.520586:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430720.520633:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836171904 00000100:00100000:3.0:1787430720.520642:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836171904 00000100:00100000:3.0:1787430720.520681:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 245 00000100:00100000:3.0:1787430720.520690:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171904:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430720.520813:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6162:x1874256836171904:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 124us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430720.520822:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 245 00000100:00100000:3.0:1787430720.523092:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430720.523949:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172032 00000100:00100000:1.0:1787430720.523958:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172032 00000100:00100000:1.0:1787430720.523996:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 246 00000100:00100000:1.0:1787430720.524003:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6706:x1874256836172032:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430720.524125:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6706:x1874256836172032:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 121us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430720.524131:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 246 00000100:00100000:3.0:1787430720.525931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430720.526014:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172160 00000100:00100000:1.0:1787430720.526023:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172160 00000100:00100000:1.0:1787430720.526075:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 247 00000100:00100000:1.0:1787430720.526085:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6706:x1874256836172160:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430720.526221:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:6706:x1874256836172160:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430720.526230:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 247 10000000:01000000:1.0:1787430721.216782:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430721.216790:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c363a8000 from 4 10000000:01000000:1.0:1787430721.216796:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430721.216847:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.216860:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.216872:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430721.216916:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847756928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430721.216978:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.217100:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847756928 00000100:00100000:3.0:1787430721.217108:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847756928 00000100:00100000:1.0:1787430721.217162:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.217364:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787430721.217375:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847756928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430721.217388:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430721.217402:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9404f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430721.217436:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430721.217447:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430721.217456:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a200, rc 0) 00000100:00100000:3.0:1787430721.217548:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847756928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.217555:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787430721.217766:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847756928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430721.217780:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430721.217800:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430721.217860:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430721.217890:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430721.217950:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c86480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.218005:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757056 00000100:00100000:3.0:1787430721.218010:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757056 00000100:00100000:3.0:1787430721.218036:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787430721.218044:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847757056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.218209:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847757056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.218216:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787430721.218377:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.218406:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.218445:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430721.218502:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07813540 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.218539:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757184 00000100:00100000:3.0:1787430721.218543:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757184 00000100:00100000:3.0:1787430721.218741:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787430721.218750:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847757184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.218868:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847757184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.218874:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787430721.218929:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430721.219535:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10488:1874256847757312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430721.219572:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430721.219811:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c86540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430721.219848:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757312 00000100:00100000:1.0:1787430721.219853:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757312 00000100:00100000:1.0:1787430721.219921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787430721.219930:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10488:x1874256847757312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430721.220015:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10488:x1874256847757312:12345-0@lo:502:llog_process_th.0 Request processed in 86us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430721.220022:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787430721.220091:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10488:1874256847757312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430721.220121:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430721.220129:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430721.220131:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787430721.220138:0:10488:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c363a8000 00000020:00000080:2.0:1787430721.220141:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430721.220231:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10488:1874256847757440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430721.220263:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430721.224984:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07813540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430721.225099:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757440 00000100:00100000:0.0:1787430721.225107:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757440 00000100:00100000:0.0:1787430721.225149:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787430721.225158:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10488:x1874256847757440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430721.225304:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:10488:x1874256847757440:12345-0@lo:502:llog_process_th.0 Request processed in 145us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430721.225311:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787430721.227376:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10488:1874256847757440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430721.227413:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430721.227421:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430721.227423:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787430721.227428:0:10488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787430721.227645:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787430721.227666:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430721.227677:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.227689:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430721.227699:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430721.227702:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c35f42000 from 4 10000000:01000000:1.0:1787430721.227705:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430721.227734:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.227743:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.227752:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430721.227780:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430721.227834:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430721.227863:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430721.228167:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757568 00000100:00100000:2.0:1787430721.228182:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757568 00000100:00100000:2.0:1787430721.228231:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787430721.228241:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847757568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430721.228254:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430721.228267:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9405d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.228288:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.228298:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.228307:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02200, rc 0) 00000100:00100000:2.0:1787430721.228342:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847757568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.228355:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787430721.228486:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430721.228498:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.228506:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430721.228555:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430721.228579:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430721.229272:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430721.229362:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757696 00000100:00100000:2.0:1787430721.229367:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757696 00000100:00100000:2.0:1787430721.229393:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787430721.229400:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847757696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.229503:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847757696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.229511:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787430721.229587:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430721.229701:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430721.229742:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430721.229766:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430721.229829:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757824 00000100:00100000:2.0:1787430721.229834:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757824 00000100:00100000:2.0:1787430721.229854:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787430721.229860:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847757824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.229926:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847757824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.229933:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787430721.230009:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847757824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430721.234258:0:10491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10491:1874256847757952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430721.234334:0:10491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430721.234542:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847757952 00000100:00100000:1.0:1787430721.234545:0:10491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11656540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430721.234549:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847757952 00000100:00100000:2.0:1787430721.234590:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787430721.234627:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10491:x1874256847757952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430721.234742:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10491:x1874256847757952:12345-0@lo:502:llog_process_th.0 Request processed in 144us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.234750:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787430721.234797:0:10491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10491:1874256847757952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787430721.234823:0:10491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430721.234837:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430721.234839:0:10491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787430721.234846:0:10491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c35f42000 00000020:00000080:1.0:1787430721.234849:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787430721.234900:0:10491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10491:1874256847758080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430721.234930:0:10491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430721.234958:0:10491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430721.235714:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758080 00000100:00100000:2.0:1787430721.235719:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758080 00000100:00100000:2.0:1787430721.235745:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787430721.235753:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10491:x1874256847758080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430721.235835:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:10491:x1874256847758080:12345-0@lo:502:llog_process_th.0 Request processed in 81us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.235842:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787430721.237468:0:10491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10491:1874256847758080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787430721.237500:0:10491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430721.237507:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430721.237509:0:10491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787430721.237514:0:10491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787430721.237582:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787430721.237730:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430721.237740:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.237752:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430721.237762:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787430721.237765:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a2800 from 4 10000000:01000000:2.0:1787430721.237767:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430721.237796:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.237803:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.237812:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430721.237830:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.237875:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430721.237914:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07813e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430721.241285:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758208 00000100:00100000:1.0:1787430721.241300:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758208 00000100:00100000:1.0:1787430721.241349:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787430721.241359:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847758208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430721.241375:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430721.241391:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9406b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.241418:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.241428:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430721.241437:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef000, rc 0) 00000100:00100000:1.0:1787430721.241517:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847758208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430721.241532:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787430721.241547:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430721.241570:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430721.241581:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430721.241680:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.241713:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.241740:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.241752:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758336 00000100:00100000:3.0:1787430721.241756:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758336 00000100:00100000:3.0:1787430721.241782:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787430721.241788:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847758336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.241886:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847758336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.241892:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787430721.241920:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.241948:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.241985:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.242008:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.242020:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758464 00000100:00100000:3.0:1787430721.242024:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758464 00000100:00100000:3.0:1787430721.242045:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787430721.242051:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847758464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.242137:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847758464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.242153:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787430721.242178:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.243257:0:10494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10494:1874256847758592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430721.243294:0:10494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430721.243355:0:10494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07813300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430721.243383:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758592 00000100:00100000:0.0:1787430721.243387:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758592 00000100:00100000:0.0:1787430721.243445:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787430721.243453:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10494:x1874256847758592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430721.243532:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10494:x1874256847758592:12345-0@lo:502:llog_process_th.0 Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430721.243539:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787430721.243595:0:10494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10494:1874256847758592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430721.243641:0:10494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430721.243649:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430721.243652:0:10494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787430721.243658:0:10494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c3a6a2800 00000020:00000080:2.0:1787430721.243661:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430721.243721:0:10494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10494:1874256847758720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430721.243748:0:10494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430721.243919:0:10494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07813300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.243946:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758720 00000100:00100000:3.0:1787430721.243950:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758720 00000100:00100000:3.0:1787430721.243965:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787430721.243971:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10494:x1874256847758720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430721.244072:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:10494:x1874256847758720:12345-0@lo:502:llog_process_th.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.244079:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787430721.244493:0:10494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10494:1874256847758720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430721.244510:0:10494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430721.244514:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430721.244516:0:10494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787430721.244520:0:10494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787430721.244979:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787430721.245008:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430721.245016:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430721.245028:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430721.245038:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430721.245041:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c04f2d000 from 4 10000000:01000000:3.0:1787430721.245043:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430721.245065:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430721.245073:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430721.245082:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430721.245096:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.245128:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.245204:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430721.245281:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758848 00000100:00100000:2.0:1787430721.245286:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758848 00000100:00100000:2.0:1787430721.245320:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787430721.245328:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847758848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430721.245336:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430721.245347:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a94079 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.245363:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.245372:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430721.245390:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03000, rc 0) 00000100:00100000:2.0:1787430721.245482:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847758848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.245489:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787430721.245535:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430721.245553:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430721.245561:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430721.245790:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430721.245816:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430721.245872:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c86e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430721.245900:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847758976 00000100:00100000:2.0:1787430721.245904:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847758976 00000100:00100000:2.0:1787430721.245958:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787430721.245965:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847758976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.246054:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847758976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.246060:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787430721.246109:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847758976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430721.246134:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847759104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430721.246165:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430721.246292:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c86e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.246317:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847759104 00000100:00100000:3.0:1787430721.246321:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847759104 00000100:00100000:3.0:1787430721.246340:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787430721.246347:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847759104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430721.246412:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847759104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.246419:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787430721.246505:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847759104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430721.246940:0:10495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10495:1874256847759232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430721.246969:0:10495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430721.247023:0:10495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07813e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430721.247051:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847759232 00000100:00100000:3.0:1787430721.247055:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847759232 00000100:00100000:3.0:1787430721.247107:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787430721.247115:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:10495:x1874256847759232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430721.247279:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:10495:x1874256847759232:12345-0@lo:502:llog_process_th.0 Request processed in 165us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.247286:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787430721.247351:0:10495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10495:1874256847759232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787430721.247370:0:10495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430721.247377:0:10495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430721.247380:0:10495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787430721.247385:0:10495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c04f2d000 00000020:00000080:0.0:1787430721.247388:0:10495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787430721.247490:0:10495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10495:1874256847759360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430721.247522:0:10495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430721.247541:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847759360 00000100:00100000:0.0:1787430721.247544:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847759360 00000100:00100000:0.0:1787430721.247563:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787430721.247570:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:10495:x1874256847759360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430721.247663:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:10495:x1874256847759360:12345-0@lo:502:llog_process_th.0 Request processed in 93us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430721.247669:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787430721.247696:0:10495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c86e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430721.247706:0:10495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:10495:1874256847759360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787430721.247723:0:10495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430721.247727:0:10495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430721.247729:0:10495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787430721.247732:0:10495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787430721.247776:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787430721.247791:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430721.247799:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430721.247809:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430721.279838:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847759488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430721.279908:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.280008:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847759616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430721.280048:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.280089:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847759616 00000100:00100000:3.0:1787430721.280097:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847759616 00000100:00100000:3.0:1787430721.280138:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430721.280148:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847759616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430721.280180:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787430721.280235:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847759616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.280254:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430721.280297:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847759616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430721.280442:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847759744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430721.280470:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430721.280526:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847759488 00000100:00100000:1.0:1787430721.280531:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847759488 00000100:00100000:3.0:1787430721.280540:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847759744 00000100:00100000:3.0:1787430721.280543:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847759744 00000100:00100000:1.0:1787430721.280579:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787430721.280586:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847759488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430721.280624:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430721.280667:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847759488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430721.280673:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787430721.280687:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787430721.280693:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847759744:12345-0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787430721.280700:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de4e00 x1874256847759488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1787430721.280701:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430721.280714:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847759488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430721.280736:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847759744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430721.280742:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787430721.280751:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de8700 x1874256847759744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430721.280763:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847759744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787430721.280953:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430721.536446:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430721.537909:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430721.537950:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172288 00000100:00100000:0.0:1787430721.537950:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430721.537962:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172288 00000100:00100000:0.0:1787430721.537981:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430721.538011:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430721.538028:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 268 00000100:00100000:1.0:1787430721.538043:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2399:x1874256836172288:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430721.538043:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430721.538070:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172800 00000100:00100000:0.0:1787430721.538075:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172800 00000100:00100000:0.0:1787430721.538115:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172672 00000100:00100000:0.0:1787430721.538118:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172672 00000100:00100000:0.0:1787430721.538144:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:0.0:1787430721.538160:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836172800:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430721.538213:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836172800:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430721.538220:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:0.0:1787430721.538236:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1787430721.538242:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836172672:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430721.538265:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836172672:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430721.538270:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1787430721.538292:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172544 00000100:00100000:0.0:1787430721.538295:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172544 00000100:00100000:0.0:1787430721.538321:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172416 00000100:00100000:0.0:1787430721.538325:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172416 00000100:00100000:1.0:1787430721.538330:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2399:x1874256836172288:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 291us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430721.538337:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 268 00000100:00100000:0.0:1787430721.538352:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:0.0:1787430721.538362:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836172544:12345-192.168.202.25@tcp:400:kworker.0 00000100:00080000:1.0:1787430721.538385:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430721.538389:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430721.538391:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836172544:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00080000:1.0:1787430721.538398:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430721.538402:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430721.538402:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:0.0:1787430721.538423:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:0.0:1787430721.539258:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836172416:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430721.539324:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836172416:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 894us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430721.539330:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00010000:00010000:0.0:1787430722.559959:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430723.269068:0:10672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787430723.583919:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430723.840080:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847759872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430723.840080:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847760000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430723.840158:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430723.840238:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430723.840266:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760000 00000100:00100000:3.0:1787430723.840274:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760000 00000100:00100000:3.0:1787430723.840330:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787430723.840341:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847760000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430723.840370:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430723.840427:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847759872 00000100:00100000:3.0:1787430723.840429:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847760000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.840433:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847759872 00000100:00100000:3.0:1787430723.840440:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787430723.840473:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430723.840473:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787430723.840490:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847759872:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787430723.840509:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de4e00 x1874256847760000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:1.0:1787430723.840514:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787430723.840533:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847760000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430723.841695:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847759872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1208us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.841709:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787430723.841778:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847759872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430723.841783:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847760128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430723.841822:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430723.841852:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760128 00000100:00100000:3.0:1787430723.841856:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760128 00000100:00080000:2.0:1787430723.841885:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430723.841938:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430723.841945:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847760128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430723.841956:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430723.841992:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847760128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430723.841997:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430723.842036:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847760256:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.842062:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787430723.842068:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd6a00 x1874256847760128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430723.842086:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847760128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430723.842140:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760256 00000100:00100000:3.0:1787430723.842145:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760256 00000100:00100000:1.0:1787430723.842207:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847760384:0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.842238:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430723.842285:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787430723.842293:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847760256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.842311:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430723.842319:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847760512:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.842330:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847760256:12345-0@lo:400:kworker.0 Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430723.842337:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787430723.842348:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430723.842515:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847760640:0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.842539:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430723.842588:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760512 00000100:00100000:3.0:1787430723.842591:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760512 00000100:00100000:1.0:1787430723.842598:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430723.842628:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847760768:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.842651:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787430723.842659:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847760512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.842665:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430723.842699:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847760512:12345-0@lo:400:kworker.0 Request processed in 42us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.842703:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760384 00000100:00100000:3.0:1787430723.842704:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787430723.842710:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760384 00000100:00100000:1.0:1787430723.842742:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760640 00000100:00100000:1.0:1787430723.842746:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760640 00000100:00100000:1.0:1787430723.842780:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760768 00000100:00100000:1.0:1787430723.842784:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760768 00000100:00100000:1.0:1787430723.842804:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787430723.842811:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847760384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.842818:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847760256:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.842847:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787430723.842851:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847760384:12345-0@lo:400:kworker.0 Request processed in 41us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430723.842856:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847760640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.842861:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787430723.842880:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430723.842888:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847760768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.842921:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847760768:12345-0@lo:400:kworker.0 Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.842927:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787430723.842947:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430723.842965:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847760768:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843079:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847760640:12345-0@lo:400:kworker.0 Request processed in 224us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430723.843087:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430723.843121:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847760512:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843135:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847760384:0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.843349:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430723.843395:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847760896:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843435:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430723.843443:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847761280:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843459:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430723.843467:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847761024:0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.843473:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430723.843500:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847761152:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843501:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430723.843535:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430723.843538:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847760896 00000100:00100000:3.0:1787430723.843542:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847760896 00000100:00100000:1.0:1787430723.843573:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761024 00000100:00100000:3.0:1787430723.843578:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761280 00000100:00100000:1.0:1787430723.843578:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761024 00000100:00100000:3.0:1787430723.843584:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761280 00000100:00100000:1.0:1787430723.843638:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761152 00000100:00100000:3.0:1787430723.843644:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787430723.843650:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761152 00000100:00100000:3.0:1787430723.843655:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847760896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.843681:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430723.843689:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847761024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843697:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847760896:12345-0@lo:400:kworker.0 Request processed in 44us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430723.843704:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787430723.843714:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787430723.843719:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847761280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430723.843727:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847761024:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.843739:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430723.843758:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787430723.843768:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847761280:12345-0@lo:400:kworker.0 Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.843770:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847761152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843784:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787430723.843803:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430723.843806:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430723.843808:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430723.843811:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847761152:12345-0@lo:400:kworker.0 Request processed in 45us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.843819:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787430723.843827:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847761280:0@lo:400:kworker.0 00010000:00080000:3.0:1787430723.843838:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de9c00 x1874256847761152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430723.843845:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847761152:0@lo:400:kworker.0 00010000:00080000:3.0:1787430723.843866:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de9180 x1874256847761024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430723.843871:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847761024:0@lo:400:kworker.0 00010000:00080000:3.0:1787430723.843890:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03deb480 x1874256847760896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430723.843896:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847760896:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843920:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847761408:0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.843940:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430723.843959:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761408 00000100:00100000:3.0:1787430723.843961:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761408 00000100:00100000:3.0:1787430723.843981:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430723.843985:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847761408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430723.844009:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847761408:12345-0@lo:400:kworker.0 Request processed in 25us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430723.844014:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787430723.844042:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430723.844060:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847760640:0@lo:400:kworker.0 00010000:00080000:3.0:1787430723.844061:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de8000 x1874256847761408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430723.844076:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847761408:0@lo:400:kworker.0 00010000:00010000:0.0:1787430724.611309:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430725.632303:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430725.844230:0:10916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing yml_node 00000100:00100000:2.0:1787430726.400929:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787430726.400952:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847761664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430726.401022:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.401075:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847761536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430726.401098:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.401131:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761664 00000100:00100000:2.0:1787430726.401138:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761664 00000100:00100000:2.0:1787430726.401198:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787430726.401207:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847761664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787430726.401242:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787430726.401287:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847761664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430726.401295:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787430726.401319:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761536 00000100:00100000:2.0:1787430726.401324:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761536 00000100:00100000:2.0:1787430726.401356:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787430726.401363:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847761536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430726.401380:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430726.401408:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847761536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430726.401415:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787430726.401434:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430726.401468:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847761664:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787430726.401481:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de4000 x1874256847761536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430726.401495:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847761536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430726.402643:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430726.402658:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847761792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430726.402703:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430726.402743:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761792 00000100:00100000:1.0:1787430726.402748:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761792 00000100:00100000:1.0:1787430726.402787:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787430726.402795:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847761792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430726.402809:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430726.402844:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847761792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430726.402851:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787430726.402868:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787430726.402891:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a63a680 x1874256847761792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430726.402907:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847761792:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787430726.655890:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430726.657247:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430726.657298:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430726.657337:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430726.657363:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430726.657392:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430726.657421:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173440 00000100:00100000:0.0:1787430726.657433:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173440 00000100:00100000:0.0:1787430726.657493:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173312 00000100:00100000:0.0:1787430726.657497:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173312 00000100:00100000:0.0:1787430726.657525:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1787430726.657537:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836173440:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430726.657635:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836173440:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430726.657643:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1787430726.657663:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1787430726.657671:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836173312:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430726.657699:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836173312:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430726.657706:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1787430726.657727:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173184 00000100:00100000:0.0:1787430726.657731:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173184 00000100:00100000:0.0:1787430726.657761:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173056 00000100:00100000:0.0:1787430726.657764:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173056 00000100:00100000:0.0:1787430726.657788:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:0.0:1787430726.657796:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836173184:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430726.657837:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836173184:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 42us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430726.657845:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:0.0:1787430726.657859:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:0.0:1787430726.657866:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2402:x1874256836173056:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430726.657890:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2402:x1874256836173056:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430726.657896:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00080000:0.0:1787430726.657916:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430726.657921:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430726.657923:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430726.657926:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430726.659226:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836172928 00000100:00100000:1.0:1787430726.659235:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836172928 00000100:00100000:1.0:1787430726.659279:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 270 00000100:00100000:1.0:1787430726.659288:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2402:x1874256836172928:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430726.659345:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2402:x1874256836172928:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 58us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430726.659352:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 270 00010000:00010000:1.0:1787430727.680286:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430728.703846:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430728.822865:0:11099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.63 00000100:00100000:2.0:1787430728.959821:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430728.959848:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847761920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430728.959940:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961358:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847762432:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961410:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961440:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847762944:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961464:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961484:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847763456:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961504:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961535:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787430728.961541:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847762304:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961562:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961579:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847762816:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961597:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961649:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847763328:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961670:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961711:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847762048:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961742:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961775:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847762560:0@lo:400:kworker.0 00000100:00100000:0.0:1787430728.961775:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762048 00000100:00100000:0.0:1787430728.961783:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762048 00000100:00100000:1.0:1787430728.961806:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.961831:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847763072:0@lo:400:kworker.0 00000100:00100000:0.0:1787430728.961837:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787430728.961848:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847762048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.961867:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430728.961873:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847761920 00000100:00100000:3.0:1787430728.961879:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847761920 00000100:00100000:3.0:1787430728.961906:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762304 00000100:00100000:3.0:1787430728.961908:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762304 00000100:00100000:3.0:1787430728.961923:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430728.961930:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847761920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430728.961956:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787430728.961977:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787430728.961986:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847762304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.962247:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847763584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430728.962287:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847762048:12345-0@lo:400:kworker.0 Request processed in 441us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430728.962298:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787430728.962299:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847761920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 367us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.962309:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430728.962334:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762432 00000100:00100000:3.0:1787430728.962338:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762432 00000100:00100000:3.0:1787430728.962361:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762560 00000100:00100000:3.0:1787430728.962364:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762560 00000100:00100000:3.0:1787430728.962389:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763072 00000100:00100000:3.0:1787430728.962391:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763072 00000100:00100000:3.0:1787430728.962408:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430728.962414:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847762432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.962454:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847762432:12345-0@lo:400:kworker.0 Request processed in 39us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.962461:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430728.962475:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430728.962482:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847762560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.962510:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847762560:12345-0@lo:400:kworker.0 Request processed in 30us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.962523:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430728.962534:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430728.962540:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847763072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430728.962582:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847762304:12345-0@lo:400:kworker.0 Request processed in 597us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430728.962590:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787430728.962736:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847763072:12345-0@lo:400:kworker.0 Request processed in 196us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.962742:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787430728.962767:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430728.962794:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.962871:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847762048:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.962994:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847762560:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.963007:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847763072:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.963028:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787430728.963034:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847762176:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.963059:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.963083:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847762688:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.963105:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430728.963106:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762176 00000100:00100000:3.0:1787430728.963112:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762176 00000100:00100000:1.0:1787430728.963140:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847763200:0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.963156:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762688 00000100:00100000:3.0:1787430728.963161:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762688 00000100:00100000:1.0:1787430728.963166:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430728.963179:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847763712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430728.963186:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763200 00000100:00100000:3.0:1787430728.963190:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763200 00000100:00100000:1.0:1787430728.963202:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430728.963211:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787430728.963219:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847762176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.963254:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847762176:12345-0@lo:400:kworker.0 Request processed in 37us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.963261:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787430728.963281:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787430728.963281:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847762176:0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.963293:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847762688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.963332:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847762688:12345-0@lo:400:kworker.0 Request processed in 43us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.963337:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787430728.963350:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787430728.963356:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847763200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.963382:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847763200:12345-0@lo:400:kworker.0 Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.963395:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787430728.963413:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430728.963432:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762944 00000100:00100000:1.0:1787430728.963437:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762944 00010000:00080000:3.0:1787430728.963442:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb5500 x1874256847762688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430728.963455:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847762688:0@lo:400:kworker.0 00010000:00080000:3.0:1787430728.963473:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb4a80 x1874256847763200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430728.963473:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763456 00000100:00100000:1.0:1787430728.963478:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763456 00000100:00100000:3.0:1787430728.963488:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847763200:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.963496:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847762816 00000100:00100000:1.0:1787430728.963500:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847762816 00000100:00100000:1.0:1787430728.963522:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763328 00000100:00100000:1.0:1787430728.963525:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763328 00000100:00100000:1.0:1787430728.963539:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787430728.963545:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847762944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.963575:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847762944:12345-0@lo:400:kworker.0 Request processed in 31us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430728.963581:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787430728.963591:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787430728.963597:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847763456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.963708:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847763456:12345-0@lo:400:kworker.0 Request processed in 110us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430728.963714:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787430728.963726:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787430728.963732:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847762816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.963756:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787430728.963761:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847762816:12345-0@lo:400:kworker.0 Request processed in 27us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430728.963773:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430728.963774:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847763328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430728.963822:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847763328:12345-0@lo:400:kworker.0 Request processed in 56us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.963829:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787430728.963845:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763584 00000100:00100000:2.0:1787430728.963850:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763584 00000100:00100000:2.0:1787430728.963877:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763712 00000100:00100000:2.0:1787430728.963891:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763712 00000100:00100000:3.0:1787430728.963906:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847761920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430728.963910:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787430728.963919:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847763584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787430728.964090:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430728.964139:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847763584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 221us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430728.964151:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787430728.964161:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787430728.964165:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00010000:00080000:3.0:1787430728.964169:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de7b80 x1874256847763584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430728.964170:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847763712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430728.964173:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1787430728.964187:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430728.964194:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847763584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430728.964230:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847763712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430728.964235:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787430728.964240:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd7b80 x1874256847763712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787430728.964251:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430728.964254:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430728.964255:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847763712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430728.964315:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847762304:0@lo:400:kworker.0 00010000:00080000:1.0:1787430728.964340:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb5f80 x1874256847762816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430728.964349:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847762816:0@lo:400:kworker.0 00010000:00080000:1.0:1787430728.964358:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb7100 x1874256847763328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430728.964366:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847763328:0@lo:400:kworker.0 00000100:00100000:1.0:1787430728.964376:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847762432:0@lo:400:kworker.0 00010000:00080000:1.0:1787430728.964385:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb6680 x1874256847762944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430728.964393:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847762944:0@lo:400:kworker.0 00010000:00080000:1.0:1787430728.964403:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb4e00 x1874256847763456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430728.964412:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847763456:0@lo:400:kworker.0 00010000:00010000:3.0:1787430729.728004:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430730.372968:0:11197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.63 00010000:00010000:0.0:1787430730.760150:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430731.520153:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430731.520180:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847763840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430731.520248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430731.520660:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430731.520686:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847763968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430731.520722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430731.520826:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763840 00000100:00100000:0.0:1787430731.520835:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763840 00000100:00100000:1.0:1787430731.520854:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847763968 00000100:00100000:1.0:1787430731.520860:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847763968 00000100:00100000:0.0:1787430731.520900:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430731.520923:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847763840:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787430731.520957:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430731.520966:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:0.0:1787430731.520977:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430731.520978:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847764096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430731.521014:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430731.521048:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847763840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430731.521057:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787430731.521073:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b19c00 x1874256847763840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430731.521110:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847763840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430731.521249:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764096 00000100:00100000:3.0:1787430731.521255:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764096 00000100:00100000:3.0:1787430731.521291:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787430731.521298:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847764096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430731.521323:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787430731.521377:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430731.521398:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847763968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430731.521410:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430731.523507:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847763968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2114us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430731.523522:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787430731.525008:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03deb480 x1874256847763968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430731.525035:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847763968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430731.525974:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847764096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430731.527527:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847764096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6222us (6504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430731.527541:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1787430731.775874:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430731.780677:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430731.780753:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430731.780784:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430731.780801:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430731.780830:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430731.780866:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173824 00000100:00100000:2.0:1787430731.780867:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173696 00000100:00100000:2.0:1787430731.780876:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173696 00000100:00100000:0.0:1787430731.780876:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173824 00000100:00100000:1.0:1787430731.780941:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174080 00000100:00100000:1.0:1787430731.780946:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174080 00000100:00100000:3.0:1787430731.780970:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173568 00000100:00100000:3.0:1787430731.780974:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173568 00000100:00100000:3.0:1787430731.781019:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 272 00000100:00100000:2.0:1787430731.781019:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:3.0:1787430731.781029:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2401:x1874256836173568:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430731.781029:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836173696:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430731.781104:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2401:x1874256836173568:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 76us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430731.781112:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 272 00000100:00100000:0.0:1787430731.782177:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1787430731.782189:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836173824:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430731.782867:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836173696:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1836us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430731.782876:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:0.0:1787430731.782925:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836173824:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 737us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430731.782932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1787430731.782959:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836173952 00000100:00100000:0.0:1787430731.782965:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836173952 00000100:00100000:0.0:1787430731.783003:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1787430731.783012:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836173952:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430731.783058:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836173952:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 47us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430731.783065:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:1.0:1787430731.783259:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:1.0:1787430731.783869:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836174080:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430731.783909:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836174080:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 643us (3123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430731.783916:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00080000:3.0:1787430731.786135:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430731.786144:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430731.786148:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430731.786151:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787430732.092057:0:11295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.63 00010000:00010000:3.0:1787430732.804149:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430733.035064:0:11343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 16:32:12 EDT 2026 00010000:00010000:3.0:1787430733.824983:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430734.080028:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847764608:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080109:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080162:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847765120:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080188:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080207:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847765632:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080225:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080257:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787430734.080264:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847764224:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080293:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080315:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847764736:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080356:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080382:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847765248:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080414:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080432:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847765760:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080453:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080478:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847764352:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080499:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080513:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847764864:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080529:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080546:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847765376:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080566:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.080586:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787430734.080592:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847764480:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.080636:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430734.081112:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764736 00000100:00100000:3.0:1787430734.081126:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764736 00000100:00100000:3.0:1787430734.081173:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764480 00000100:00100000:3.0:1787430734.081176:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764480 00000100:00100000:3.0:1787430734.081193:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787430734.081201:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847764736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.081273:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847764736:12345-0@lo:400:kworker.0 Request processed in 72us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.081282:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787430734.081670:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430734.081678:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847764480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.081712:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847764480:12345-0@lo:400:kworker.0 Request processed in 36us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.081718:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430734.081742:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764608 00000100:00100000:3.0:1787430734.081746:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764608 00000100:00100000:3.0:1787430734.081772:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764352 00000100:00100000:3.0:1787430734.081775:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764352 00000100:00100000:3.0:1787430734.081785:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764864 00000100:00100000:3.0:1787430734.081787:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764864 00000100:00100000:3.0:1787430734.081807:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847765376 00000100:00100000:3.0:1787430734.081810:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847765376 00000100:00100000:3.0:1787430734.081823:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430734.081829:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847764608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.081860:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847764608:12345-0@lo:400:kworker.0 Request processed in 32us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.081866:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430734.081878:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430734.081884:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847764352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.081911:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847764352:12345-0@lo:400:kworker.0 Request processed in 28us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.081917:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430734.081984:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787430734.081998:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847764864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.082044:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847764864:12345-0@lo:400:kworker.0 Request processed in 47us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.082050:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787430734.082065:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787430734.082083:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847765376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.082113:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847765376:12345-0@lo:400:kworker.0 Request processed in 42us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.082119:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787430734.082202:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430734.082215:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847766144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430734.082244:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430734.082274:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847764736:0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.082285:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847764608:0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.082447:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766144 00000100:00100000:3.0:1787430734.082452:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766144 00000100:00100000:3.0:1787430734.082474:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787430734.082480:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847766144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430734.082504:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430734.082541:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847766144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.082547:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787430734.082576:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847766144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430734.082743:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764224 00000100:00100000:3.0:1787430734.082755:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764224 00000100:00100000:3.0:1787430734.082783:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787430734.082789:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847764224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.082825:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847764224:12345-0@lo:400:kworker.0 Request processed in 36us (2531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.082830:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787430734.082859:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847765120 00000100:00100000:3.0:1787430734.082863:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847765120 00000100:00100000:3.0:1787430734.082893:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847765632 00000100:00100000:3.0:1787430734.082896:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847765632 00000100:00100000:3.0:1787430734.082909:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847765248 00000100:00100000:3.0:1787430734.082912:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847765248 00000100:00100000:3.0:1787430734.083026:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847765760 00000100:00100000:2.0:1787430734.083028:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847764480:0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.083033:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847765760 00000100:00100000:2.0:1787430734.083040:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847764992:0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.083058:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430734.083067:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847765120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.083086:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.083115:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847765504:0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.083123:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847765120:12345-0@lo:400:kworker.0 Request processed in 57us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.083131:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430734.083148:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787430734.083149:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430734.083161:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847765632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.083183:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847764352:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.083202:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847764864:0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.083204:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847765632:12345-0@lo:400:kworker.0 Request processed in 43us (2975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.083214:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787430734.083218:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847765376:0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.083230:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430734.083239:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847765248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.083241:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847765888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430734.083285:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847765248:12345-0@lo:400:kworker.0 Request processed in 47us (2869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.083287:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.083315:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430734.083322:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847766016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430734.083341:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430734.083372:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787430734.083381:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847765760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.083413:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847765760:12345-0@lo:400:kworker.0 Request processed in 34us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.083421:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787430734.083429:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430734.083449:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847764992 00000100:00100000:3.0:1787430734.083454:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847764992 00000100:00100000:2.0:1787430734.083463:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847765504 00000100:00100000:2.0:1787430734.083468:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847765504 00000100:00100000:3.0:1787430734.083479:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430734.083489:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847764992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.083498:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787430734.083508:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847765504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430734.083536:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847764992:12345-0@lo:400:kworker.0 Request processed in 49us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.083544:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787430734.083552:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847765504:12345-0@lo:400:kworker.0 Request processed in 45us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.083559:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787430734.083571:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430734.083576:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430734.083595:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847765888 00000100:00100000:2.0:1787430734.083618:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847765888 00000100:00100000:2.0:1787430734.083639:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766016 00000100:00100000:2.0:1787430734.083643:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766016 00000100:00080000:3.0:1787430734.083660:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430734.083682:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847764224:0@lo:400:kworker.0 00010000:00080000:3.0:1787430734.083697:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd5180 x1874256847765248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430734.083709:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847765248:0@lo:400:kworker.0 00010000:00080000:3.0:1787430734.083721:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b0357bb80 x1874256847765760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430734.083729:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847765760:0@lo:400:kworker.0 00010000:00080000:3.0:1787430734.083742:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd4380 x1874256847765120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430734.083750:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847765120:0@lo:400:kworker.0 00010000:00080000:3.0:1787430734.083763:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03578000 x1874256847765632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430734.083769:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430734.083778:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847765632:0@lo:400:kworker.0 00000100:00100000:0.0:1787430734.083785:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847765888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430734.083811:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430734.083847:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847765888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.083853:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787430734.084067:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0c700 x1874256847765888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430734.084095:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847765888:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787430734.084109:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd7100 x1874256847764992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430734.084117:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847764992:0@lo:400:kworker.0 00010000:00080000:3.0:1787430734.084128:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c11579180 x1874256847765504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430734.084137:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847765504:0@lo:400:kworker.0 00000100:00100000:2.0:1787430734.085145:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787430734.085158:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847766016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787430734.085177:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430734.085238:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847766016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.085245:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787430734.085396:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de7800 x1874256847766016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430734.085409:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847766016:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787430734.847933:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430735.871699:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430736.639818:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430736.639841:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847766272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430736.639914:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430736.639971:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766272 00000100:00100000:1.0:1787430736.639977:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766272 00000100:00100000:1.0:1787430736.640020:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430736.640026:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847766272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430736.640060:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430736.640106:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847766272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430736.640113:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787430736.640135:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787430736.640163:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b18380 x1874256847766272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430736.640177:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847766272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430736.640560:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430736.640570:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847766400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430736.640596:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430736.640701:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766400 00000100:00100000:2.0:1787430736.640707:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766400 00000100:00100000:2.0:1787430736.640745:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787430736.640759:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847766400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787430736.640784:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787430736.640825:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847766400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430736.640832:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787430736.640905:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847766400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430736.641054:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847766528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430736.641081:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430736.641153:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766528 00000100:00100000:2.0:1787430736.641158:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766528 00000100:00100000:2.0:1787430736.641192:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787430736.641197:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847766528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430736.641206:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430736.641228:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847766528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430736.641232:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787430736.641327:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787430736.641342:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0ed80 x1874256847766528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430736.641352:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847766528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430736.894303:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430736.894387:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430736.894415:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430736.894483:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174464 00000100:00100000:3.0:1787430736.894488:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174336 00000100:00100000:1.0:1787430736.894493:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174464 00000100:00100000:3.0:1787430736.894495:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174336 00000100:00080000:0.0:1787430736.894557:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430736.894562:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430736.894577:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1787430736.894658:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1787430736.894667:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2402:x1874256836174336:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430736.894742:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2402:x1874256836174336:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430736.894749:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:2.0:1787430736.894896:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174208 00000100:00100000:2.0:1787430736.894901:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174208 00000100:00100000:1.0:1787430736.894930:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836174464:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430736.894982:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836174464:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 383us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430736.895000:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1787430736.895036:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 274 00000100:00100000:3.0:1787430736.895221:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2402:x1874256836174208:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430736.895261:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2402:x1874256836174208:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 217us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430736.895268:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 274 00010000:00010000:3.0:1787430736.895761:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430736.899709:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430736.899831:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430736.906988:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174592 00000100:00100000:1.0:1787430736.906988:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174720 00000100:00100000:3.0:1787430736.907003:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174592 00000100:00100000:1.0:1787430736.907003:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174720 00000100:00080000:0.0:1787430736.907092:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430736.907097:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430736.907112:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1787430736.907125:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2398:x1874256836174720:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:1.0:1787430736.907161:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f99 00000100:00080000:1.0:1787430736.907172:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b41800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787430736.907218:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787430736.907272:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1787430736.907282:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2398:x1874256836174592:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:3.0:1787430736.907303:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f92 00000100:00080000:3.0:1787430736.907308:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8e2b02bbb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787430736.907337:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787430736.907499:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+2:2398:x1874256836174592:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 217us (7799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430736.907500:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+2:2398:x1874256836174720:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 376us (7665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430736.907515:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:1.0:1787430736.907522:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00010000:00010000:3.0:1787430736.909305:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430736.909353:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430737.919781:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430738.943802:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430739.199788:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847766656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430739.199871:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.199956:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766656 00000100:00100000:3.0:1787430739.199963:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766656 00000100:00100000:3.0:1787430739.200004:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430739.200013:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847766656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430739.200059:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430739.200098:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847766656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.200105:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787430739.200108:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847766912:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200128:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847767040:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200165:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200184:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847767552:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200223:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847768064:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200241:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200269:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767040 00000100:00100000:3.0:1787430739.200273:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767040 00000100:00100000:3.0:1787430739.200297:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767552 00000100:00100000:3.0:1787430739.200300:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767552 00000100:00100000:3.0:1787430739.200323:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768064 00000100:00100000:3.0:1787430739.200326:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768064 00000100:00100000:3.0:1787430739.200339:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787430739.200345:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847767040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200379:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847767040:12345-0@lo:400:kworker.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.200396:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787430739.200409:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787430739.200414:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847767552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200428:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847767424:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200441:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847767552:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.200447:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787430739.200448:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200457:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767424 00000100:00100000:1.0:1787430739.200457:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847767936:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200472:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767424 00000100:00100000:1.0:1787430739.200475:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200486:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767936 00000100:00100000:3.0:1787430739.200489:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767936 00000100:00100000:1.0:1787430739.200496:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766912 00000100:00100000:1.0:1787430739.200499:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766912 00000100:00100000:3.0:1787430739.200501:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787430739.200505:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847768064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200524:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787430739.200531:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847768064:12345-0@lo:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430739.200531:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847766912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200537:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787430739.200548:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787430739.200554:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847767424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200559:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847766912:12345-0@lo:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430739.200565:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787430739.200574:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847767424:12345-0@lo:400:kworker.0 Request processed in 21us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.200579:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787430739.200588:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430739.200593:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847767936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200635:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847767936:12345-0@lo:400:kworker.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430739.200635:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847766912:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200640:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787430739.200647:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847767424:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200655:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847767936:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200686:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847766784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430739.200710:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430739.200727:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847767296:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200745:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430739.200759:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847767808:0@lo:400:kworker.0 00000100:00080000:3.0:1787430739.200762:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430739.200767:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787430739.200777:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767296 00000100:00100000:1.0:1787430739.200779:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200780:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767296 00000100:00100000:1.0:1787430739.200800:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847768320:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200802:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787430739.200808:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847767296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200821:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200854:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847767296:12345-0@lo:400:kworker.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.200860:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787430739.200877:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847767296:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200884:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847767040:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200886:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787430739.200891:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847767168:0@lo:400:kworker.0 00010000:00080000:3.0:1787430739.200895:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1bb80 x1874256847767552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430739.200905:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847767552:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200914:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787430739.200915:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1a680 x1874256847768064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430739.200923:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847768064:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200943:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847767680:0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.200946:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767168 00000100:00100000:3.0:1787430739.200948:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767168 00000100:00100000:1.0:1787430739.200966:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.200971:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430739.200979:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847767168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.200983:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847768192:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.201000:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.201004:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847767168:12345-0@lo:400:kworker.0 Request processed in 27us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.201010:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430739.201038:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767808 00000100:00100000:3.0:1787430739.201041:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767808 00000100:00100000:1.0:1787430739.201041:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847767168:0@lo:400:kworker.0 00000100:00100000:1.0:1787430739.201058:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847766784 00000100:00100000:1.0:1787430739.201061:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847766784 00000100:00100000:3.0:1787430739.201063:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768320 00000100:00100000:3.0:1787430739.201070:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768320 00000100:00100000:3.0:1787430739.201084:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847767680 00000100:00100000:3.0:1787430739.201086:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847767680 00000100:00100000:1.0:1787430739.201086:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430739.201092:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768192 00000100:00100000:0.0:1787430739.201098:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768192 00000100:00100000:1.0:1787430739.201099:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847766784:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430739.201100:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787430739.201110:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847767808:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787430739.201120:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430739.201134:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430739.201148:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847768320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430739.201149:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847767808:12345-0@lo:400:kworker.0 Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430739.201157:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1874256847766784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.201160:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430739.201162:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787430739.201173:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430739.201181:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847767680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430739.201197:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847768320:12345-0@lo:400:kworker.0 Request processed in 53us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430739.201205:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787430739.201217:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847767680:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430739.201223:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430739.201232:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847768192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430739.201271:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847768192:12345-0@lo:400:kworker.0 Request processed in 40us (269us total) trans 0 rc 0/0 00000100:00080000:2.0:1787430739.202310:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430739.202315:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787430739.202355:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1b800 x1874256847767680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430739.202367:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847767680:0@lo:400:kworker.0 00010000:00080000:2.0:1787430739.202379:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b19c00 x1874256847768192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430739.202387:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847768192:0@lo:400:kworker.0 00010000:00080000:2.0:1787430739.202396:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b18380 x1874256847766784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430739.202408:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847766784:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787430739.202426:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b19500 x1874256847767808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430739.202434:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847767808:0@lo:400:kworker.0 00010000:00080000:2.0:1787430739.202443:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a4dfb80 x1874256847768320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430739.202451:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847768320:0@lo:400:kworker.0 00000100:00100000:2.0:1787430739.202480:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430739.202490:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847768448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430739.202526:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430739.202990:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787430739.203817:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430739.203856:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768448 00000100:00100000:0.0:1787430739.203863:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768448 00000100:00100000:0.0:1787430739.203907:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787430739.203916:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847768448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430739.203936:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430739.204007:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847768448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430739.204013:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787430739.204068:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03ae0000 x1874256847768448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430739.204086:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847768448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430739.204697:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847766656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430739.206205:0:8830:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787430739.207047:0:8830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:3.0:1787430739.968739:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430740.999661:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430741.759746:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847768576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430741.759820:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430741.759827:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430741.759840:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847768704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430741.759869:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430741.759900:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768576 00000100:00100000:2.0:1787430741.759903:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768704 00000100:00100000:3.0:1787430741.759907:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768576 00000100:00100000:2.0:1787430741.759907:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768704 00000100:00100000:3.0:1787430741.759949:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787430741.759949:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430741.759958:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847768576:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430741.759958:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847768704:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1787430741.759986:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1787430741.759999:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00080000:1.0:1787430741.760078:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430741.760766:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430741.760811:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847768832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430741.760923:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847768704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 965us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430741.760925:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847768576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 969us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430741.760931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430741.760946:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787430741.760999:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847768704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430741.761022:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430741.761136:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768832 00000100:00100000:2.0:1787430741.761141:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768832 00000100:00100000:2.0:1787430741.761215:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787430741.761224:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847768832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430741.761236:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430741.761271:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847768832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430741.761277:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787430741.761326:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb7800 x1874256847768576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430741.761339:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847768576:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787430741.761366:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0f800 x1874256847768832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430741.761375:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847768832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787430741.761687:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430742.016190:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.016234:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.016262:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.016288:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836175104 00000100:00100000:0.0:1787430742.016298:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836175104 00000100:00100000:0.0:1787430742.016355:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174976 00000100:00100000:0.0:1787430742.016359:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174976 00000100:00100000:0.0:1787430742.016393:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:0.0:1787430742.016405:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836175104:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430742.016487:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836175104:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 84us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.016494:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:0.0:1787430742.016511:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:0.0:1787430742.016518:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836174976:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430742.016541:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836174976:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.016547:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00080000:0.0:1787430742.016586:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430742.016591:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430742.016741:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836174848 00000100:00100000:2.0:1787430742.016746:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836174848 00000100:00100000:2.0:1787430742.016784:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 276 00000100:00100000:2.0:1787430742.016792:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2400:x1874256836174848:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430742.016821:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2400:x1874256836174848:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430742.016826:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 276 00010000:00010000:2.0:1787430742.016990:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787430742.273364:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:0.0:1787430742.273374:0:9485:0:(genops.c:885:class_export_put()) final put ffff8e2b03b46000/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:1.0:1787430742.274141:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03b46000/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-OST0001 00000020:00000080:1.0:1787430742.274193:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03b41800 for lustre-OST0001 00000001:00100000:3.0:1787430742.288299:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:3.0:1787430742.288310:0:8404:0:(genops.c:885:class_export_put()) final put ffff8e2b02bb9800/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:1.0:1787430742.289505:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b02bb9800/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-OST0000 00000020:00000080:1.0:1787430742.289562:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b02bbb000 for lustre-OST0000 00000001:02000400:2.0:1787430742.546870:0:11972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:32:21 (1787430741) === 00000100:00100000:0.0:1787430742.832656:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430742.832783:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836175232 00000100:00100000:1.0:1787430742.832796:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836175232 00000100:00100000:1.0:1787430742.832853:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 277 00000100:00100000:1.0:1787430742.832863:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:8712:x1874256836175232:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787430742.832881:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430742.832903:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360efa00/0x4dbb683ba6a94087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913877f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430742.832934:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360efa00/0x4dbb683ba6a94087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913877f expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430742.832943:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360efa00/0x4dbb683ba6a94087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913877f expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430742.832969:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360efa00, rc 0) 00000100:00100000:1.0:1787430742.833090:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8712:x1874256836175232:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 226us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.833098:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 277 00000100:00100000:2.0:1787430742.843884:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.844009:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836175360 00000100:00100000:0.0:1787430742.844020:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836175360 00000100:00100000:0.0:1787430742.844107:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 278 00000100:00100000:0.0:1787430742.844117:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8712:x1874256836175360:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787430742.844312:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8712:x1874256836175360:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 197us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.844326:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 278 00000100:00100000:0.0:1787430742.851037:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430742.851219:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836175488 00000100:00100000:1.0:1787430742.851249:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836175488 00000100:00100000:1.0:1787430742.851328:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 279 00000100:00100000:1.0:1787430742.851343:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8712:x1874256836175488:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787430742.851571:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8712:x1874256836175488:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 230us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.851579:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 279 00000100:00100000:1.0:1787430742.854520:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.854592:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836175616 00000100:00100000:0.0:1787430742.854638:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836175616 00000100:00100000:0.0:1787430742.854712:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:0.0:1787430742.854742:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8716:x1874256836175616:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430742.854954:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8716:x1874256836175616:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 214us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.854964:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:2.0:1787430742.881986:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430742.882150:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836175744 00000100:00100000:1.0:1787430742.882160:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836175744 00000100:00100000:1.0:1787430742.882219:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 281 00000100:00100000:1.0:1787430742.882230:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8716:x1874256836175744:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430742.882393:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8716:x1874256836175744:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 164us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.882402:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 281 00000100:00100000:3.0:1787430742.884711:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430742.885322:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836175872 00000100:00100000:2.0:1787430742.885334:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836175872 00000100:00100000:2.0:1787430742.885392:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 282 00000100:00100000:2.0:1787430742.885403:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8716:x1874256836175872:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430742.885737:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8716:x1874256836175872:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 334us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430742.885746:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 282 00000100:00100000:2.0:1787430742.891313:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.891468:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176000 00000100:00100000:0.0:1787430742.891478:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176000 00000100:00100000:0.0:1787430742.891541:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 283 00000100:00100000:0.0:1787430742.891552:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:8712:x1874256836176000:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787430742.891567:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430742.891584:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1c600/0x4dbb683ba6a9408e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91387b0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430742.891639:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1c600/0x4dbb683ba6a9408e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b0 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430742.891649:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1c600/0x4dbb683ba6a9408e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b0 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430742.891659:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1c600, rc 0) 00000100:00100000:0.0:1787430742.891754:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:8712:x1874256836176000:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 203us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.891762:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 283 00000100:00100000:3.0:1787430742.893792:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430742.893894:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176128 00000100:00100000:1.0:1787430742.893903:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176128 00000100:00100000:1.0:1787430742.894010:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 284 00000100:00100000:1.0:1787430742.894020:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:8712:x1874256836176128:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787430742.894043:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787430742.894072:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787430742.894076:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787430742.894079:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787430742.894082:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787430742.894084:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787430742.895093:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:8712:x1874256836176128:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 1070us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.895110:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 284 00000100:00100000:2.0:1787430742.899355:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430742.899445:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176256 00000100:00100000:3.0:1787430742.899454:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176256 00000100:00100000:3.0:1787430742.899507:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 285 00000100:00100000:3.0:1787430742.899517:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:8712:x1874256836176256:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787430742.899534:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430742.899551:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91387b7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430742.899578:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430742.899589:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430742.899597:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:3.0:1787430742.899679:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8712:x1874256836176256:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 163us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430742.899685:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 285 00000100:00100000:3.0:1787430742.901213:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430742.901342:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176384 00000100:00100000:1.0:1787430742.901348:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176384 00000100:00100000:1.0:1787430742.901390:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 286 00000100:00100000:1.0:1787430742.901396:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8712:x1874256836176384:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787430742.901620:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8712:x1874256836176384:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 223us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.901626:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 286 00000100:00100000:1.0:1787430742.902828:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.902917:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176512 00000100:00100000:0.0:1787430742.902922:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176512 00000100:00100000:0.0:1787430742.902985:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 287 00000100:00100000:0.0:1787430742.903005:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8712:x1874256836176512:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787430742.903101:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8712:x1874256836176512:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.903111:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 287 00000100:00100000:2.0:1787430742.906249:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430742.906347:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176640 00000100:00100000:1.0:1787430742.906355:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176640 00000100:00100000:1.0:1787430742.906427:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 288 00000100:00100000:1.0:1787430742.906434:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8723:x1874256836176640:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430742.906570:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8723:x1874256836176640:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 137us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.906576:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 288 00000100:00100000:2.0:1787430742.908224:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.908365:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176768 00000100:00100000:0.0:1787430742.908374:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176768 00000100:00100000:0.0:1787430742.908501:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 289 00000100:00100000:0.0:1787430742.908512:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8723:x1874256836176768:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430742.908655:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:8723:x1874256836176768:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 145us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.908661:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 289 00000100:00100000:2.0:1787430742.912682:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430742.912711:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430742.912742:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430742.912774:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430742.912845:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836176896 00000100:00100000:1.0:1787430742.912854:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836176896 00000100:00100000:1.0:1787430742.912894:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177152 00000100:00100000:1.0:1787430742.912896:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177152 00000100:00100000:1.0:1787430742.912910:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177280 00000100:00100000:1.0:1787430742.912911:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177280 00000100:00100000:1.0:1787430742.912928:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177408 00000100:00100000:1.0:1787430742.912930:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177408 00000100:00100000:1.0:1787430742.912940:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:1.0:1787430742.912946:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836177280:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430742.913020:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836177280:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.913028:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:1.0:1787430742.913043:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:1.0:1787430742.913047:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836177408:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430742.913065:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836177408:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 18us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.913068:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:1.0:1787430742.913075:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1787430742.913077:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874256836176896:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787430742.913095:0:6496:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a623e317-dfe7-4c7d-8620-46d6b83d3031@192.168.202.25@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1787430742.913122:0:6496:0:(genops.c:1385:class_connect()) connect: client a623e317-dfe7-4c7d-8620-46d6b83d3031, cookie 0x4dbb683ba6a9409c 00000004:00100000:1.0:1787430742.913143:0:6496:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787430742.913264:0:6496:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a75f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430742.913289:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2398:x1874256836176896:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 210us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.913294:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1787430742.913303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1787430742.913306:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874256836177152:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787430742.913321:0:6496:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a623e317-dfe7-4c7d-8620-46d6b83d3031@192.168.202.25@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1787430742.913337:0:6496:0:(genops.c:1385:class_connect()) connect: client a623e317-dfe7-4c7d-8620-46d6b83d3031, cookie 0x4dbb683ba6a940a3 00000004:00100000:1.0:1787430742.913345:0:6496:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787430742.913385:0:6496:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a75c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430742.913400:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2398:x1874256836177152:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 93us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.913404:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1787430742.915114:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430742.915154:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.915241:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177536 00000100:00100000:0.0:1787430742.915249:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177536 00000100:00100000:0.0:1787430742.915311:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177024 00000100:00100000:0.0:1787430742.915314:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177024 00000100:00100000:0.0:1787430742.915338:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:0.0:1787430742.915346:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:0:x1874256836177536:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787430742.915377:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787430742.915435:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:0:x1874256836177536:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.915440:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:0.0:1787430742.915451:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:0.0:1787430742.915455:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:0:x1874256836177024:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787430742.915466:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:2.0:1787430742.915826:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430742.915829:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430742.915926:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:0:x1874256836177024:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 470us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.915931:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1787430742.916451:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430742.916511:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177664 00000100:00100000:3.0:1787430742.916523:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177664 00000100:00100000:3.0:1787430742.916564:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:3.0:1787430742.916573:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836177664:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787430742.916591:0:8819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787430742.916669:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836177664:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430742.916677:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:0.0:1787430742.918264:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430742.918343:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177792 00000100:00100000:2.0:1787430742.918349:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177792 00000100:00100000:2.0:1787430742.918421:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1787430742.918428:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836177792:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787430742.918479:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836177792:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430742.918484:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1787430742.919702:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430742.920042:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836177920 00000100:00100000:3.0:1787430742.920048:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836177920 00000100:00100000:3.0:1787430742.920083:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:3.0:1787430742.920088:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874256836177920:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787430742.920117:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a623e317-dfe7-4c7d-8620-46d6b83d3031@192.168.202.25@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1787430742.920141:0:8408:0:(genops.c:1385:class_connect()) connect: client a623e317-dfe7-4c7d-8620-46d6b83d3031, cookie 0x4dbb683ba6a940aa 00002000:00100000:3.0:1787430742.920153:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a623e317-dfe7-4c7d-8620-46d6b83d3031/ffff8e2b03ca3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787430742.920165:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787430742.920235:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787430742.920262:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8e2b03ca4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430742.920492:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2398:x1874256836177920:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 401us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430742.920500:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:0.0:1787430742.920801:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.920932:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430742.921207:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178176 00000100:00100000:3.0:1787430742.921214:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178176 00000100:00100000:3.0:1787430742.921255:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:3.0:1787430742.921263:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836178176:12345-192.168.202.25@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787430742.921308:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836178176:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 46us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430742.921329:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1787430742.921706:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178048 00000100:00100000:1.0:1787430742.921712:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178048 00000100:00100000:1.0:1787430742.921775:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:1.0:1787430742.921782:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874256836178048:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787430742.921805:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a623e317-dfe7-4c7d-8620-46d6b83d3031@192.168.202.25@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1787430742.921832:0:8409:0:(genops.c:1385:class_connect()) connect: client a623e317-dfe7-4c7d-8620-46d6b83d3031, cookie 0x4dbb683ba6a940b1 00002000:00100000:1.0:1787430742.921840:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a623e317-dfe7-4c7d-8620-46d6b83d3031/ffff8e2c3a75a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787430742.921855:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787430742.921913:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787430742.921935:0:8409:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a75f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430742.921974:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2398:x1874256836178048:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 192us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.921996:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1787430742.923516:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430742.923628:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178304 00000100:00100000:0.0:1787430742.923633:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178304 00000100:00100000:0.0:1787430742.923663:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:0.0:1787430742.923669:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836178304:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787430742.923734:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787430742.923796:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:8712:x1874256836178304:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 126us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.923804:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00010000:00010000:3.0:1787430743.039875:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430744.064764:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430744.319922:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430744.319945:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847768960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430744.320020:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430744.320130:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847768960 00000100:00100000:3.0:1787430744.320138:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847768960 00000100:00100000:3.0:1787430744.320186:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787430744.320196:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847768960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430744.320226:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430744.320271:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847768960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430744.320277:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787430744.320316:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847768960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430744.320703:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847769472:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.320732:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.320751:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847769984:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.320770:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.320781:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847770496:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.320797:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.320818:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787430744.320823:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847769088:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.320846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.320866:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847769600:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.320885:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.320915:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847770112:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.320933:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.320958:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847769216:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.320990:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.321005:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847769728:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321024:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.321040:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847770240:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321060:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.321073:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787430744.321078:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847769344:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321097:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.321112:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847769856:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321130:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.321144:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847770368:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321177:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430744.321206:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769472 00000100:00100000:0.0:1787430744.321211:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769472 00000100:00100000:0.0:1787430744.321239:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769600 00000100:00100000:0.0:1787430744.321241:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769600 00000100:00100000:0.0:1787430744.321261:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847770112 00000100:00100000:0.0:1787430744.321263:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847770112 00000100:00100000:0.0:1787430744.321273:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769216 00000100:00100000:0.0:1787430744.321275:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769216 00000100:00100000:0.0:1787430744.321285:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769728 00000100:00100000:0.0:1787430744.321287:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769728 00000100:00100000:0.0:1787430744.321296:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847770240 00000100:00100000:0.0:1787430744.321298:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847770240 00000100:00100000:0.0:1787430744.321311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430744.321326:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847769472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321367:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847769472:12345-0@lo:400:kworker.0 Request processed in 43us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321374:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430744.321388:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430744.321394:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847769600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321418:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847769600:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321424:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430744.321433:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787430744.321438:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847770112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321457:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847770112:12345-0@lo:400:kworker.0 Request processed in 19us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321462:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787430744.321470:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787430744.321475:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847769216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321499:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847769216:12345-0@lo:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321504:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787430744.321514:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787430744.321519:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847769728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321541:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847769728:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321546:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787430744.321555:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787430744.321567:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847770240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321588:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847770240:12345-0@lo:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321593:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787430744.321633:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769984 00000100:00100000:0.0:1787430744.321636:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769984 00000100:00100000:0.0:1787430744.321661:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847770496 00000100:00100000:0.0:1787430744.321664:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847770496 00000100:00100000:0.0:1787430744.321676:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769856 00000100:00100000:0.0:1787430744.321678:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769856 00000100:00100000:0.0:1787430744.321688:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847770368 00000100:00100000:0.0:1787430744.321690:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847770368 00000100:00100000:0.0:1787430744.321701:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430744.321707:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847769984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321736:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847769984:12345-0@lo:400:kworker.0 Request processed in 29us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321742:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430744.321753:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430744.321758:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321784:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847770496:12345-0@lo:400:kworker.0 Request processed in 27us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321790:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430744.321800:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430744.321806:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321831:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847769856:12345-0@lo:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321838:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430744.321855:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787430744.321861:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847770368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321887:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847770368:12345-0@lo:400:kworker.0 Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321893:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787430744.321912:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769088 00000100:00100000:0.0:1787430744.321916:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769088 00000100:00100000:0.0:1787430744.321940:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787430744.321946:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847769088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.321974:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847769088:12345-0@lo:400:kworker.0 Request processed in 29us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.321993:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787430744.322028:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847769344 00000100:00100000:0.0:1787430744.322032:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847769344 00000100:00100000:0.0:1787430744.322054:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787430744.322061:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847769344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.322091:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847769344:12345-0@lo:400:kworker.0 Request processed in 31us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430744.322097:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787430744.322118:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430744.322122:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430744.322125:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430744.322128:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430744.322157:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847769344:0@lo:400:kworker.0 00010000:00080000:0.0:1787430744.322170:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0c000 x1874256847769856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430744.322180:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847769856:0@lo:400:kworker.0 00010000:00080000:0.0:1787430744.322199:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb5c00 x1874256847770368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430744.322208:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847770368:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.322218:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847769216:0@lo:400:kworker.0 00010000:00080000:0.0:1787430744.322226:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0d880 x1874256847769728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430744.322234:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847769728:0@lo:400:kworker.0 00010000:00080000:0.0:1787430744.322242:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0c700 x1874256847770240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430744.322249:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847770240:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.322286:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847769088:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.322297:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847769600:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.322306:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847770112:0@lo:400:kworker.0 00000100:00100000:0.0:1787430744.322315:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847769472:0@lo:400:kworker.0 00010000:00080000:0.0:1787430744.322324:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0fb80 x1874256847769984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430744.322331:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847769984:0@lo:400:kworker.0 00010000:00080000:0.0:1787430744.322339:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb4380 x1874256847770496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430744.322345:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847770496:0@lo:400:kworker.0 00000100:00100000:3.0:1787430744.324313:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847770624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430744.324377:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430744.324532:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430744.324541:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847770752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430744.324564:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430744.324648:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847770624 00000100:00100000:1.0:1787430744.324656:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847770624 00000100:00100000:1.0:1787430744.324704:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847770752 00000100:00100000:1.0:1787430744.324708:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847770752 00000100:00100000:1.0:1787430744.324725:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787430744.324734:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847770624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430744.324775:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430744.324822:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847770624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430744.324830:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787430744.324847:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787430744.324853:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847770752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787430744.324861:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430744.324884:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847770752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430744.324890:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787430744.324995:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b18380 x1874256847770752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430744.325012:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847770752:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787430744.325043:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03ae0380 x1874256847770624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430744.325053:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847770624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787430745.088085:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430746.111914:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430746.428931:0:12165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787430746.881278:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430746.881300:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847770880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430746.881361:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430746.881540:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847771008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430746.881572:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430746.881818:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430746.881844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430746.881890:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771008 00000100:00100000:0.0:1787430746.881897:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771008 00000100:00100000:0.0:1787430746.881984:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771136 00000100:00100000:0.0:1787430746.881988:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771136 00000100:00100000:0.0:1787430746.882018:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787430746.882028:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847771008:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787430746.882037:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787430746.882060:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430746.882062:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787430746.882076:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847771136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430746.882090:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430746.882123:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847771008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430746.882132:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787430746.882136:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847771136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430746.882145:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787430746.882177:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9e680 x1874256847771008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787430746.882183:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9ca80 x1874256847771136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430746.882206:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847771008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430746.882208:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430746.884502:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847770880 00000100:00100000:3.0:1787430746.884520:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847770880 00000100:00100000:3.0:1787430746.884576:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787430746.884586:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847770880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430746.884639:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787430746.884717:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847770880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (3355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430746.884725:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787430746.884824:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847770880:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787430747.145541:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430748.160495:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430748.160541:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430748.160565:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430748.160587:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430748.160595:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178432 00000100:00100000:3.0:1787430748.160621:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178432 00000100:00100000:2.0:1787430748.160630:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430748.160649:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430748.160668:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 291 00000100:00100000:2.0:1787430748.160670:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430748.160678:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836178432:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430748.160689:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178688 00000100:00100000:2.0:1787430748.160692:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178688 00000100:00100000:2.0:1787430748.160725:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178944 00000100:00100000:2.0:1787430748.160727:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178944 00000100:00100000:3.0:1787430748.160740:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836178432:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430748.160747:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 291 00000100:00100000:2.0:1787430748.160750:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178560 00000100:00100000:2.0:1787430748.160752:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178560 00000100:00100000:2.0:1787430748.160762:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836178816 00000100:00100000:2.0:1787430748.160764:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836178816 00000100:00100000:2.0:1787430748.160777:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:3.0:1787430748.161628:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:3.0:1787430748.161640:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836178944:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430748.161678:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836178944:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 41us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430748.161686:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:3.0:1787430748.161705:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:3.0:1787430748.161711:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836178560:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430748.161733:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836178560:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430748.161740:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:3.0:1787430748.161758:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:3.0:1787430748.161764:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836178816:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430748.161786:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836178816:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430748.161791:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:2.0:1787430748.161981:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836178688:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430748.162028:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836178688:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1244us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430748.162035:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:2.0:1787430748.162060:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179200 00000100:00100000:2.0:1787430748.162066:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179200 00000100:00100000:2.0:1787430748.162099:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179072 00000100:00100000:2.0:1787430748.162102:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179072 00000100:00100000:2.0:1787430748.162124:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:2.0:1787430748.162131:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836179200:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430748.162156:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836179200:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430748.162163:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:2.0:1787430748.162174:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:2.0:1787430748.162181:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836179072:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430748.162202:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2401:x1874256836179072:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430748.162207:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00010000:00010000:3.0:1787430748.163439:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430748.164213:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430748.164220:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430748.164223:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430748.164225:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1787430748.419341:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00000001:00100000:1.0:1787430748.420038:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00000001:00100000:0.0:1787430748.420375:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00000001:00100000:2.0:1787430748.420543:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00010000:00010000:0.0:1787430749.184837:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430749.441149:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847771776:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441162:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847771392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430749.441224:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430749.441224:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441279:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847771264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430749.441304:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441328:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847771904:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441353:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441374:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847772416:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441399:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430749.441461:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847772288:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441467:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847772928:0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.441492:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441496:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847771520:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441525:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441545:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847772032:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441573:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847771648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430749.441591:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441683:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847772160:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441701:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441720:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847772672:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441737:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.441748:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847773184:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.441760:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430749.441821:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771776 00000100:00100000:1.0:1787430749.441829:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771776 00000100:00100000:0.0:1787430749.441830:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847772800:0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.441861:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430749.441870:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772416 00000100:00100000:1.0:1787430749.441872:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772416 00000100:00100000:0.0:1787430749.441888:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772288 00000100:00100000:0.0:1787430749.441891:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772288 00000100:00100000:1.0:1787430749.441894:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772800 00000100:00100000:1.0:1787430749.441895:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772800 00000100:00100000:0.0:1787430749.441911:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787430749.441918:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787430749.441920:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847771776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.441925:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847772416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.441977:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847772416:12345-0@lo:400:kworker.0 Request processed in 52us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430749.441977:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847771776:12345-0@lo:400:kworker.0 Request processed in 59us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430749.441984:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787430749.441987:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787430749.442003:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787430749.442007:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787430749.442010:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847772288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442012:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847772800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442037:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847772288:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430749.442037:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847772800:12345-0@lo:400:kworker.0 Request processed in 24us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430749.442043:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787430749.442046:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787430749.442060:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787430749.442062:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430749.442066:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430749.442075:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847772544:0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442086:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772032 00000100:00100000:1.0:1787430749.442090:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772032 00000100:00100000:0.0:1787430749.442095:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430749.442109:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787430749.442110:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847773056:0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442116:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847772032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442131:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430749.442141:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847772032:12345-0@lo:400:kworker.0 Request processed in 26us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430749.442154:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787430749.442167:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847772032:0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442173:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430749.442190:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772672 00000100:00100000:0.0:1787430749.442194:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772672 00010000:00080000:1.0:1787430749.442200:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9ed80 x1874256847772416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430749.442211:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847772416:0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442222:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773184 00000100:00100000:0.0:1787430749.442224:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773184 00000100:00100000:1.0:1787430749.442227:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772928 00000100:00100000:1.0:1787430749.442230:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772928 00000100:00100000:0.0:1787430749.442237:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772544 00000100:00100000:0.0:1787430749.442239:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772544 00000100:00100000:1.0:1787430749.442251:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787430749.442253:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773056 00000100:00100000:0.0:1787430749.442256:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773056 00000100:00100000:1.0:1787430749.442257:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847772928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442281:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787430749.442287:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847772672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442289:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847772928:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430749.442294:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787430749.442336:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771392 00000100:00100000:3.0:1787430749.442340:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771392 00000100:00100000:3.0:1787430749.442363:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771264 00000100:00100000:3.0:1787430749.442366:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771264 00000100:00100000:3.0:1787430749.442382:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787430749.442389:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847771392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430749.442407:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1787430749.442441:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9fb80 x1874256847772928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430749.442447:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847772672:12345-0@lo:400:kworker.0 Request processed in 161us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430749.442451:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847772928:0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442454:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787430749.442466:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787430749.442473:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847773184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442483:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787430749.442489:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847772544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442499:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847773184:12345-0@lo:400:kworker.0 Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430749.442505:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787430749.442516:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787430749.442517:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847772544:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430749.442521:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3630:x1874256847773056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442522:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787430749.442534:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430749.442537:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430749.442539:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430749.442544:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3630:x1874256847773056:12345-0@lo:400:kworker.0 Request processed in 23us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430749.442549:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787430749.442555:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847771776:0@lo:400:kworker.0 00000100:00100000:1.0:1787430749.442564:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847772288:0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442568:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787430749.442574:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847771264:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430749.442579:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847772800:0@lo:400:kworker.0 00002000:00000024:0.0:1787430749.442583:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430749.442625:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847771264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430749.442632:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787430749.442656:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9e680 x1874256847771264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430749.442670:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847771264:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787430749.442692:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9ea00 x1874256847772544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787430749.442695:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9f480 x1874256847772672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430749.442705:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847772672:0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442706:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847772544:0@lo:400:kworker.0 00010000:00080000:1.0:1787430749.442714:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9d500 x1874256847773184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787430749.442715:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9f800 x1874256847773056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430749.442723:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847773184:0@lo:400:kworker.0 00000100:00100000:0.0:1787430749.442723:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847773056:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.442789:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847771392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 400us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.442796:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787430749.442813:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03578a80 x1874256847771392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430749.442818:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771904 00000100:00100000:3.0:1787430749.442821:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771904 00000100:00100000:0.0:1787430749.442824:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847771392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430749.442837:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771648 00000100:00100000:3.0:1787430749.442839:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771648 00000100:00100000:3.0:1787430749.442850:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847772160 00000100:00100000:3.0:1787430749.442851:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847772160 00000100:00100000:3.0:1787430749.442862:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787430749.442867:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847771904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.442901:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847771904:12345-0@lo:400:kworker.0 Request processed in 33us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.442907:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787430749.442918:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787430749.442923:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847771648:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430749.442923:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847771904:0@lo:400:kworker.0 00000004:00000024:3.0:1787430749.442953:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430749.442999:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847771648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.443006:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787430749.443019:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430749.443022:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847771648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430749.443025:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847772160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.443056:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847772160:12345-0@lo:400:kworker.0 Request processed in 31us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.443062:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430749.443073:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847772160:0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.443079:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847771520 00000100:00100000:3.0:1787430749.443083:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847771520 00000100:00100000:3.0:1787430749.443113:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787430749.443120:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847771520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430749.443156:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847771520:12345-0@lo:400:kworker.0 Request processed in 36us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.443163:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787430749.443175:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847771520:0@lo:400:kworker.0 00010000:00010000:2.0:1787430750.208315:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787430751.182563:0:12479:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787430751.182831:0:12479:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787430751.231940:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430751.999834:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430751.999903:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430751.999994:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773312 00000100:00100000:1.0:1787430752.000001:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773312 00000100:00100000:1.0:1787430752.000042:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430752.000049:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847773312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430752.000071:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430752.000102:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847773312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430752.000107:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787430752.000121:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787430752.000148:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0c380 x1874256847773312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430752.000186:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430752.000291:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430752.000301:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847773440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430752.000344:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430752.000423:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773440 00000100:00100000:3.0:1787430752.000428:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773440 00000100:00100000:3.0:1787430752.000467:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787430752.000474:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847773440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787430752.000485:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430752.000516:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847773440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430752.000637:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787430752.000658:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b02b0f100 x1874256847773440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430752.000677:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847773440:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787430752.000827:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430752.000857:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847773568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430752.000878:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430752.001114:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773568 00000100:00100000:2.0:1787430752.001124:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773568 00000100:00100000:1.0:1787430752.001256:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787430752.001262:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847773568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787430752.001281:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787430752.001318:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847773568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430752.001332:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787430752.001388:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847773568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787430752.256410:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787430752.388920:0:12576:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430752.389182:0:12576:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787430753.280248:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430753.280280:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430753.280291:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179456 00000100:00100000:3.0:1787430753.280301:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179456 00000100:00100000:0.0:1787430753.280303:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430753.280325:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430753.280342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430753.280352:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179712 00000100:00100000:3.0:1787430753.280355:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179712 00000100:00100000:0.0:1787430753.280359:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430753.280368:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179584 00000100:00100000:3.0:1787430753.280370:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179584 00000100:00100000:3.0:1787430753.280380:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179840 00000100:00100000:3.0:1787430753.280383:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179840 00000100:00100000:3.0:1787430753.280397:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 92 00000100:00100000:0.0:1787430753.280397:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430753.280406:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836179456:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430753.280416:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179968 00000100:00100000:0.0:1787430753.280426:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179968 00000100:00100000:0.0:1787430753.280450:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180096 00000100:00100000:0.0:1787430753.280452:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180096 00000100:00100000:0.0:1787430753.280470:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:3.0:1787430753.280471:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836179456:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430753.280477:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836179968:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430753.280478:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 92 00000100:00100000:3.0:1787430753.280493:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 93 00000100:00100000:3.0:1787430753.280499:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836179712:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430753.280500:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836179968:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430753.280506:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:0.0:1787430753.280517:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:3.0:1787430753.280518:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836179712:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430753.280523:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836180096:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430753.280537:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 93 00000100:00100000:0.0:1787430753.280541:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836180096:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430753.280547:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1787430753.280565:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00100000:0.0:1787430753.280572:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836179584:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430753.280635:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836179584:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 63us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430753.280642:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00100000:0.0:1787430753.280655:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:0.0:1787430753.280662:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836179840:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430753.280684:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836179840:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430753.280690:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00080000:3.0:1787430753.280715:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430753.280719:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430753.280722:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430753.280724:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430753.280732:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836179328 00000100:00100000:3.0:1787430753.280741:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836179328 00000100:00100000:3.0:1787430753.280778:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 293 00000100:00100000:3.0:1787430753.280784:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836179328:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430753.280808:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836179328:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430753.280814:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 293 00010000:00010000:0.0:1787430753.282718:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787430753.536059:0:12675:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430753.536294:0:12675:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787430754.312092:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430754.560096:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430754.560115:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847773696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430754.560169:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430754.560218:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773696 00000100:00100000:1.0:1787430754.560223:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773696 00000100:00100000:1.0:1787430754.560259:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430754.560269:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847773696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787430754.560297:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430754.560339:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847773696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430754.560347:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787430754.560381:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1a680 x1874256847773696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430754.560395:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847773696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430754.560510:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430754.560520:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847773824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430754.560548:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787430754.560571:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430754.560579:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773824 00000100:00100000:3.0:1787430754.560581:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773824 00000100:00100000:3.0:1787430754.560614:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430754.560619:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847773824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430754.560627:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430754.560648:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847773824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430754.560652:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430754.560670:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847773952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430754.560687:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430754.560712:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847773952 00000100:00100000:3.0:1787430754.560715:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847773952 00000100:00100000:3.0:1787430754.560732:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787430754.560738:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847773952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430754.560760:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430754.560793:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847773952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430754.560811:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787430754.560828:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430754.560845:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847773952:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1787430754.560859:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03490380 x1874256847773824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430754.560867:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847773824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430754.561093:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847774080:0@lo:400:kworker.0 00000100:00100000:1.0:1787430754.561116:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430754.561203:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774080 00000100:00100000:3.0:1787430754.561206:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774080 00000100:00100000:3.0:1787430754.561225:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787430754.561229:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847774080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561460:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847774464:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561484:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430754.561504:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774464 00000100:00100000:0.0:1787430754.561508:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774464 00000100:00100000:0.0:1787430754.561532:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787430754.561539:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847774464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561571:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847774464:12345-0@lo:400:kworker.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430754.561576:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787430754.561597:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847774464:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561625:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847774208:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561640:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430754.561652:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430754.561655:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847774336:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561666:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430754.561679:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774208 00000100:00100000:0.0:1787430754.561682:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774208 00000100:00100000:0.0:1787430754.561697:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787430754.561700:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847774208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561721:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847774208:12345-0@lo:400:kworker.0 Request processed in 20us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430754.561725:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787430754.561739:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774336 00000100:00100000:0.0:1787430754.561743:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774336 00000100:00100000:0.0:1787430754.561762:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787430754.561775:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847774336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561805:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847774336:12345-0@lo:400:kworker.0 Request processed in 31us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430754.561811:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787430754.561837:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847774336:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.561843:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847774208:0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.563115:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847774720:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.563115:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847774976:0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.563156:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430754.563156:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430754.563282:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847774080:0@lo:400:kworker.0 00000100:00100000:1.0:1787430754.563308:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847774592:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.563560:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774976 00000100:00100000:0.0:1787430754.563566:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774976 00000100:00100000:2.0:1787430754.563590:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847775232:0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.563628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430754.563628:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787430754.563637:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847774976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.563646:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430754.563651:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847774848:0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.563669:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430754.563677:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847774976:12345-0@lo:400:kworker.0 Request processed in 43us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430754.563684:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787430754.563692:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774720 00000100:00100000:2.0:1787430754.563695:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774720 00000100:00100000:0.0:1787430754.563696:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774848 00000100:00100000:0.0:1787430754.563698:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774848 00000100:00100000:2.0:1787430754.563715:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847775232 00000100:00100000:0.0:1787430754.563716:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787430754.563718:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847775232 00000100:00100000:0.0:1787430754.563721:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847774848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.563751:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787430754.563751:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847774848:12345-0@lo:400:kworker.0 Request processed in 31us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430754.563757:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847774720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.563758:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787430754.563779:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430754.563783:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430754.563799:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847774720:12345-0@lo:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00010000:00080000:0.0:1787430754.563800:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a4de300 x1874256847774976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430754.563805:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787430754.563818:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787430754.563823:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847775232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.563823:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847774976:0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.563848:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847775232:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430754.563854:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1787430754.563897:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a4dc000 x1874256847774848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430754.563906:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847774848:0@lo:400:kworker.0 00010000:00080000:2.0:1787430754.563925:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a4dfb80 x1874256847774720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430754.563933:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847774720:0@lo:400:kworker.0 00010000:00080000:2.0:1787430754.563942:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf1180 x1874256847775232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430754.563949:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847775232:0@lo:400:kworker.0 00000100:00100000:3.0:1787430754.563951:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847774080:12345-0@lo:400:kworker.0 Request processed in 2720us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430754.563960:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787430754.564180:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430754.564202:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847775104:0@lo:400:kworker.0 00000100:00100000:0.0:1787430754.564208:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847774592 00000100:00100000:0.0:1787430754.564211:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847774592 00000100:00100000:1.0:1787430754.564223:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787430754.564262:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430754.564446:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847775104 00000100:00100000:0.0:1787430754.564449:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787430754.564450:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847775104 00000100:00100000:0.0:1787430754.564507:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847774592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.564910:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787430754.564918:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847775104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430754.564942:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847774592:0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.564949:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847775104:12345-0@lo:400:kworker.0 Request processed in 33us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430754.564952:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847775104:0@lo:400:kworker.0 00000100:00100000:2.0:1787430754.564955:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787430754.564994:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847774592:12345-0@lo:400:kworker.0 Request processed in 537us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430754.565001:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787430754.565069:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:0.0:1787430754.676535:0:12772:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430754.676962:0:12772:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787430755.334938:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787430755.844003:0:12869:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787430755.844155:0:12869:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787430756.353908:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430757.119717:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430757.119742:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847775360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430757.119812:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430757.119977:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847775488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430757.120015:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430757.120047:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847775488 00000100:00100000:2.0:1787430757.120055:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847775488 00000100:00100000:2.0:1787430757.120120:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787430757.120131:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847775488:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430757.120141:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847775360 00000100:00100000:3.0:1787430757.120148:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847775360 00002000:00000024:2.0:1787430757.120159:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430757.120250:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430757.120258:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847775360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430757.120280:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787430757.120320:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847775360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430757.120333:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430757.120380:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847775360:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787430757.120457:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430757.120472:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847775488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 342us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430757.120480:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787430757.120485:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1b480 x1874256847775488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430757.120500:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847775488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430757.120513:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430757.120519:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847775616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430757.120540:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430757.120645:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847775616 00000100:00100000:2.0:1787430757.120656:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847775616 00000100:00080000:1.0:1787430757.120682:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430757.120696:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787430757.120703:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847775616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430757.120715:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430757.120754:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847775616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430757.120760:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787430757.120855:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dead80 x1874256847775616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430757.120879:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847775616:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787430757.375962:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787430758.054450:0:13013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787430758.399296:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430758.399341:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430758.399373:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430758.399400:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430758.399419:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430758.399437:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430758.399544:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180224 00000100:00100000:0.0:1787430758.399554:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180224 00000100:00100000:0.0:1787430758.399696:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 295 00000100:00100000:0.0:1787430758.399709:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836180224:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430758.399776:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836180224:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 70us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430758.399784:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 295 00000100:00100000:0.0:1787430758.399846:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180480 00000100:00100000:0.0:1787430758.399863:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180480 00000100:00100000:0.0:1787430758.399898:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180736 00000100:00100000:0.0:1787430758.399901:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180736 00000100:00100000:0.0:1787430758.399916:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180352 00000100:00100000:0.0:1787430758.399919:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180352 00000100:00100000:0.0:1787430758.399931:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180608 00000100:00100000:0.0:1787430758.399934:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180608 00000100:00100000:0.0:1787430758.399962:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:0.0:1787430758.399969:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836180480:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430758.400177:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430758.400199:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180992 00000100:00100000:3.0:1787430758.400203:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180992 00000100:00100000:3.0:1787430758.400230:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836180864 00000100:00100000:3.0:1787430758.400233:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836180864 00000100:00100000:3.0:1787430758.400254:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:3.0:1787430758.400261:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180992:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430758.400289:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180992:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430758.400295:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:3.0:1787430758.400309:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1787430758.400315:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180864:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430758.400338:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180864:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430758.400344:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1787430758.400379:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:3.0:1787430758.400393:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180736:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430758.400470:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180736:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 77us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430758.400477:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:3.0:1787430758.400490:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:3.0:1787430758.400497:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836180352:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430758.400519:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836180352:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430758.400525:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:3.0:1787430758.400537:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:3.0:1787430758.400543:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180608:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430758.400564:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836180608:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430758.400570:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00080000:3.0:1787430758.400585:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430758.400589:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430758.400591:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430758.400593:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430758.400771:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836180480:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430758.400779:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 102 00010000:00010000:0.0:1787430758.401110:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430759.423877:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430759.679854:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847776000:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.679921:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.679966:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847776512:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680003:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.680024:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847777024:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680041:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.680064:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787430759.680069:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847776128:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680086:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.680103:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847776640:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680130:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.680143:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847777152:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680154:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.680175:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776000 00000100:00100000:0.0:1787430759.680180:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776000 00000100:00100000:0.0:1787430759.680211:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787430759.680217:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847776000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680253:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847776000:12345-0@lo:400:kworker.0 Request processed in 36us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.680275:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787430759.680293:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776512 00000100:00100000:0.0:1787430759.680296:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776512 00000100:00100000:0.0:1787430759.680316:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847777024 00000100:00100000:0.0:1787430759.680318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847777024 00000100:00100000:0.0:1787430759.680328:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776128 00000100:00100000:0.0:1787430759.680329:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776128 00000100:00100000:0.0:1787430759.680336:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787430759.680340:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847776512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680360:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847776512:12345-0@lo:400:kworker.0 Request processed in 20us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.680364:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787430759.680371:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787430759.680374:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847777024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680387:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847777024:12345-0@lo:400:kworker.0 Request processed in 13us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.680390:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787430759.680396:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787430759.680401:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847776128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680435:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847776128:12345-0@lo:400:kworker.0 Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.680441:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787430759.680459:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776640 00000100:00100000:0.0:1787430759.680462:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776640 00000100:00100000:0.0:1787430759.680482:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847777152 00000100:00100000:0.0:1787430759.680484:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847777152 00000100:00100000:0.0:1787430759.680499:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787430759.680511:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847776640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680538:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847776640:12345-0@lo:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.680543:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787430759.680554:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430759.680559:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847777152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680580:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847777152:12345-0@lo:400:kworker.0 Request processed in 21us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.680584:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430759.680708:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847776128:0@lo:400:kworker.0 00010000:00080000:0.0:1787430759.680721:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9d180 x1874256847776640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430759.680731:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847776640:0@lo:400:kworker.0 00010000:00080000:0.0:1787430759.680740:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a4dca80 x1874256847777152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430759.680748:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847777152:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.680756:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847776000:0@lo:400:kworker.0 00010000:00080000:0.0:1787430759.680765:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9c700 x1874256847776512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430759.680771:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847776512:0@lo:400:kworker.0 00010000:00080000:0.0:1787430759.680777:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9c380 x1874256847777024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430759.680782:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847777024:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.680922:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847775872:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.680942:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.680961:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847776384:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.680972:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.680983:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847776896:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.680993:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.681001:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787430759.681004:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847775744:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.681018:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.681029:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847776256:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.681040:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.681047:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847776768:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.681056:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.681063:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847777280:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.681072:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.681398:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776768 00000100:00100000:0.0:1787430759.681403:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776768 00000100:00100000:0.0:1787430759.681438:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847777280 00000100:00100000:0.0:1787430759.681442:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847777280 00000100:00100000:0.0:1787430759.681458:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787430759.681464:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847776768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.681500:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847776768:12345-0@lo:400:kworker.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.681506:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787430759.681517:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787430759.681524:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847777280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.681548:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847777280:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.681555:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787430759.681569:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847775872 00000100:00100000:0.0:1787430759.681572:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847775872 00000100:00100000:0.0:1787430759.681590:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776384 00000100:00100000:0.0:1787430759.681593:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776384 00000100:00100000:0.0:1787430759.681629:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776896 00000100:00100000:0.0:1787430759.681633:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776896 00000100:00100000:0.0:1787430759.681647:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787430759.681653:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847775872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.681692:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847775872:12345-0@lo:400:kworker.0 Request processed in 40us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.681699:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787430759.681711:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787430759.681718:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847776384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.681751:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847776384:12345-0@lo:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.681757:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787430759.681768:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787430759.681774:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847776896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.681797:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847776896:12345-0@lo:400:kworker.0 Request processed in 24us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.681803:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1787430759.681956:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d9fb80 x1874256847776768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430759.681967:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847776768:0@lo:400:kworker.0 00010000:00080000:0.0:1787430759.681976:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a4dfb80 x1874256847777280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430759.681984:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847777280:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.681993:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847775872:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.682003:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847776384:0@lo:400:kworker.0 00000100:00100000:0.0:1787430759.682011:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847776896:0@lo:400:kworker.0 00000100:00100000:3.0:1787430759.682134:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847776256 00000100:00100000:3.0:1787430759.682138:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847776256 00000100:00100000:3.0:1787430759.682166:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787430759.682173:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847776256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430759.682210:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847776256:12345-0@lo:400:kworker.0 Request processed in 37us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.682215:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787430759.682239:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430759.682243:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430759.682245:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430759.682247:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787430759.682371:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847775744 00000100:00100000:3.0:1787430759.682375:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847775744 00000100:00100000:3.0:1787430759.682407:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787430759.682413:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847775744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430759.682444:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847775744:12345-0@lo:400:kworker.0 Request processed in 31us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.682450:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787430759.682474:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430759.682484:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847777408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430759.682507:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.682530:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847777408 00000100:00100000:3.0:1787430759.682534:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847777408 00000100:00100000:3.0:1787430759.682552:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787430759.682557:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847777408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430759.682578:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430759.682629:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847777408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.682635:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787430759.682663:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847777408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430759.682692:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847775744:0@lo:400:kworker.0 00000100:00100000:3.0:1787430759.682700:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847776256:0@lo:400:kworker.0 00000100:00100000:2.0:1787430759.682845:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847777536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430759.682871:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.682927:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847777536 00000100:00100000:3.0:1787430759.682938:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847777536 00000100:00100000:3.0:1787430759.682966:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430759.682972:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847777536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430759.682991:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430759.683115:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847777664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430759.683145:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430759.683185:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847777664 00000100:00100000:1.0:1787430759.683188:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847777664 00000100:00100000:1.0:1787430759.683213:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787430759.683219:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847777664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787430759.683228:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430759.683256:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847777664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430759.683260:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787430759.683279:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b18000 x1874256847777664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430759.683301:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847777664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430759.683439:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847777536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 466us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.683445:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787430759.683487:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03e54e00 x1874256847777536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430759.683505:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847777536:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787430759.872474:0:13160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0bf5cca0 20000000:00000080:1.0:1787430759.872552:0:13160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2c36175000 uarg=0000000000000000 20000000:01000000:1.0:1787430759.872593:0:13160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787430759.872842:0:13160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787430759.872848:0:13160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787430759.873199:0:13161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787430759.873418:0:13160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787430759.877950:0:13160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787430759.877979:0:13160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.877997:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878003:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878008:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878011:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878028:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878033:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878036:0:13160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878071:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878081:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 12 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.878093:0:13160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847777792:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430759.878197:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878206:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 23 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.878215:0:13160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847777920:0@lo:104: 00000100:00100000:1.0:1787430759.878248:0:13160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430759.878329:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878335:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 23 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.878345:0:13160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778048:0@lo:104: 00000100:00100000:1.0:1787430759.878360:0:13160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430759.878386:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878392:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 23 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.878400:0:13160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778176:0@lo:104: 00000100:00100000:1.0:1787430759.878420:0:13160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430759.878441:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878450:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 23 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.878455:0:13160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778304:0@lo:104: 00000100:00100000:1.0:1787430759.878475:0:13160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430759.878503:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.878512:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 12 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.878518:0:13160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778432:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430759.878535:0:13160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430759.878619:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847777920 00000100:00100000:3.0:1787430759.878625:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847777920 00000100:00100000:3.0:1787430759.878654:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847778048 00000100:00100000:3.0:1787430759.878656:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847778048 00000100:00100000:3.0:1787430759.878661:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847778176 00000100:00100000:3.0:1787430759.878662:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847778176 00000100:00100000:3.0:1787430759.878667:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847778304 00000100:00100000:3.0:1787430759.878668:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847778304 00000100:00100000:3.0:1787430759.878676:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787430759.878682:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:13160:x1874256847777920:12345-0@lo:104: 00010000:00010000:3.0:1787430759.878691:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.878729:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430759.878733:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:13160:x1874256847777920:12345-0@lo:104: Request processed in 52us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.878737:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787430759.878750:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430759.878753:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:13160:x1874256847778048:12345-0@lo:104: 00010000:00010000:3.0:1787430759.878757:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.878783:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787430759.878786:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+5:13160:x1874256847778048:12345-0@lo:104: Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.878790:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430759.878798:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430759.878801:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:13160:x1874256847778176:12345-0@lo:104: 00010000:00010000:3.0:1787430759.878806:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.878820:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787430759.878823:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:13160:x1874256847778176:12345-0@lo:104: Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.878826:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430759.878832:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787430759.878845:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:13160:x1874256847778304:12345-0@lo:104: 00010000:00010000:3.0:1787430759.878850:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.878876:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787430759.878881:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:13160:x1874256847778304:12345-0@lo:104: Request processed in 45us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.878886:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787430759.878906:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787430759.878912:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.878919:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430759.878928:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.878936:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430759.878943:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430759.878949:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787430759.878978:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.878985:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430759.879004:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879010:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a94079 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94080 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879023:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787430759.879026:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879031:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430759.879035:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879042:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430759.879058:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430759.879064:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787430759.879078:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879083:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430759.879091:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879097:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a9406b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94072 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879106:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430759.879108:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879113:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eee00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430759.879116:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879122:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430759.879128:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430759.879133:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787430759.879152:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879158:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430759.879174:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879180:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360eee00/0x4dbb683ba6a9405d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94064 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879189:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430759.879192:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879197:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430759.879200:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879207:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430759.879213:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430759.879217:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787430759.879228:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879234:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430759.879239:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.879523:0:13160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847777920:0@lo:104: 00000100:00100000:1.0:1787430759.879542:0:13160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778048:0@lo:104: 00000100:00100000:1.0:1787430759.879549:0:13160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778176:0@lo:104: 00000100:00100000:1.0:1787430759.879556:0:13160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778304:0@lo:104: 00010000:00010000:0.0:1787430759.879733:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430759.879739:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430759.879743:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430759.879786:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a9404f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a94056 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.879799:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430759.879801:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430759.879803:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430759.879822:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847778560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430759.879868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.879893:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430759.879899:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847778688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430759.879917:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.880017:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847778816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430759.880039:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.880336:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430759.880343:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847778944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430759.880366:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.880410:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847778560 00000100:00100000:0.0:1787430759.880416:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847778560 00010000:00010000:0.0:1787430759.880445:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 24 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430759.880493:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847778688 00000100:00100000:0.0:1787430759.880496:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847778688 00010000:00010000:0.0:1787430759.880509:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 25 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430759.880525:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847778816 00000100:00100000:0.0:1787430759.880527:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847778816 00010000:00010000:0.0:1787430759.880537:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 26 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430759.880551:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787430759.880559:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+26:3627:x1874256847778560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430759.880569:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430759.880575:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 26 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880585:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 26 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880620:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a94080 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a94079 expref: 26 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880635:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430759.880668:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+25:3627:x1874256847778560:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.880675:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787430759.880690:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787430759.880696:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847778688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430759.880713:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430759.880718:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 24 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880726:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 24 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880736:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ef000/0x4dbb683ba6a94072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a9406b expref: 24 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880744:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430759.880765:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3627:x1874256847778688:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.880771:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787430759.880782:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787430759.880788:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3629:x1874256847778816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430759.880795:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430759.880799:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 22 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880807:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 22 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880816:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f02200/0x4dbb683ba6a94064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a9405d expref: 22 pid: 6492 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.880824:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430759.880857:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3629:x1874256847778816:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.880871:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787430759.880898:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847778688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430759.880905:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847778560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430759.881222:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847778816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430759.881282:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847778944 00000100:00100000:0.0:1787430759.881286:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847778944 00010000:00010000:0.0:1787430759.881300:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 21 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430759.881324:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787430759.881332:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3629:x1874256847778944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430759.881339:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430759.881343:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 21 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.881351:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 21 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.881361:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a94056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a9404f expref: 21 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.881369:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430759.881403:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3629:x1874256847778944:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.881410:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430759.881460:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847778944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430759.882823:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430759.882859:0:13160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847777792:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430759.882872:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836181120 00000100:00100000:0.0:1787430759.882882:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836181120 00010000:00010000:0.0:1787430759.882910:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 13 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430759.882967:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:0.0:1787430759.882976:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836181120:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430759.882986:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430759.883036:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 13 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.883049:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 13 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.883063:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430759.883593:0:13160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a94048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138778 expref: 13 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.883626:0:13160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1874256847778432:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430759.883659:0:13160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430759.883717:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430759.883864:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:2400:x1874256836181120:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 889us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.883872:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:1.0:1787430759.883881:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836181248 00000100:00100000:1.0:1787430759.883888:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836181248 00010000:00010000:1.0:1787430759.883908:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 12 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.883940:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:1.0:1787430759.883948:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11440450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:2400:x1874256836181248:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430759.883959:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430759.883964:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 12 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.883973:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 12 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.883984:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a94095 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b7 expref: 12 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884007:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884015:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884028:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884034:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884041:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884047:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884053:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430759.884057:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884064:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884085:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.884093:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430759.884112:0:13160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.884122:0:13160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.884127:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11440450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:2400:x1874256836181248:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 178us (410us total) trans 0 rc 0/0 00010000:00010000:2.0:1787430759.884133:0:13160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ee400/0x4dbb683ba6a940b8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430759.884147:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00010000:00010000:0.0:1787430760.449215:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430761.469520:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430761.469622:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836181376 00000100:00100000:1.0:1787430761.469632:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836181376 00000100:00100000:1.0:1787430761.469691:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 297 00000100:00100000:1.0:1787430761.469702:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:6162:x1874256836181376:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430761.469719:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430761.469741:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91387e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430761.469768:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430761.469780:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430761.469789:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360eea00, rc 0) 00000100:00100000:1.0:1787430761.469855:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836181376:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 154us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430761.469862:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 297 00000100:00100000:3.0:1787430761.475309:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430761.475357:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836181504 00000100:00100000:3.0:1787430761.475367:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836181504 00000100:00100000:3.0:1787430761.475417:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 298 00000100:00100000:3.0:1787430761.475429:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836181504:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.475590:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836181504:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 162us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.475614:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 298 00010000:00010000:0.0:1787430761.475713:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430761.478456:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430761.478716:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836181632 00000100:00100000:3.0:1787430761.478725:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836181632 00000100:00100000:3.0:1787430761.478777:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 299 00000100:00100000:3.0:1787430761.478787:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836181632:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.478923:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836181632:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 137us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.478931:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 299 00000100:00100000:0.0:1787430761.486986:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430761.487065:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836181760 00000100:00100000:3.0:1787430761.487075:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836181760 00000100:00100000:3.0:1787430761.487176:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 300 00000100:00100000:3.0:1787430761.487187:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836181760:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430761.487207:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430761.487226:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91387ef expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.487258:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.487269:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.487278:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a400, rc 0) 00000100:00100000:3.0:1787430761.487336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836181760:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.487357:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 300 00000100:00100000:3.0:1787430761.491753:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430761.491863:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836181888 00000100:00100000:0.0:1787430761.491874:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836181888 00000100:00100000:0.0:1787430761.491923:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 301 00000100:00100000:0.0:1787430761.491934:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836181888:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430761.492192:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836181888:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 258us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430761.492200:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 301 00000100:00100000:3.0:1787430761.495418:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430761.495648:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182016 00000100:00100000:2.0:1787430761.495659:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182016 00000100:00100000:2.0:1787430761.495711:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 302 00000100:00100000:2.0:1787430761.495721:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836182016:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430761.495861:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836182016:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 140us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430761.495870:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 302 10000000:01000000:3.0:1787430761.855680:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430761.855687:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c363a8000 from 7 10000000:01000000:3.0:1787430761.855690:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430761.855738:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.855746:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.855755:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430761.855774:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.855838:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.855905:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1fc52540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430761.856057:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779072 00000100:00100000:0.0:1787430761.856071:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779072 00000100:00100000:0.0:1787430761.856149:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787430761.856159:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847779072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430761.856170:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430761.856182:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a940cd expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430761.856205:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430761.856214:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430761.856224:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d800, rc 0) 00000100:00100000:0.0:1787430761.856265:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847779072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430761.856270:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787430761.856461:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430761.856477:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430761.856487:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430761.856550:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430761.856582:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430761.856772:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.856825:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779200 00000100:00100000:3.0:1787430761.856830:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779200 00000100:00100000:3.0:1787430761.856852:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787430761.856859:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847779200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.856955:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847779200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.856961:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787430761.856996:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.857021:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.857058:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.857069:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1fc52540 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.857079:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779328 00000100:00100000:3.0:1787430761.857082:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779328 00000100:00100000:3.0:1787430761.857095:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787430761.857101:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847779328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.857170:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847779328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.857176:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787430761.857235:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430761.858060:0:13314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787430761.858113:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787430761.858131:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430761.858139:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.858149:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430761.858159:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430761.858162:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c35f42000 from 7 10000000:01000000:3.0:1787430761.858165:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430761.858186:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.858194:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.858203:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430761.858225:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.858257:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.858278:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.858291:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779456 00000100:00100000:3.0:1787430761.858295:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779456 00000100:00100000:3.0:1787430761.858315:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787430761.858321:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847779456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430761.858330:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430761.858339:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a940db expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.858356:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.858366:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.858373:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b600, rc 0) 00000100:00100000:3.0:1787430761.858399:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847779456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.858405:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787430761.858434:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430761.858513:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.858521:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430761.858564:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.858586:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.858597:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.858625:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779584 00000100:00100000:3.0:1787430761.858628:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779584 00000100:00100000:3.0:1787430761.858641:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787430761.858647:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847779584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.858714:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847779584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.858721:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787430761.858745:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.858766:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.858796:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.858812:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.858833:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779712 00000100:00100000:3.0:1787430761.858837:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779712 00000100:00100000:3.0:1787430761.858852:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787430761.858858:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847779712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.858914:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847779712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.858921:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787430761.858966:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430761.860115:0:13315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787430761.860243:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787430761.860261:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430761.860269:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.860279:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430761.860289:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430761.860292:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a2800 from 7 10000000:01000000:3.0:1787430761.860294:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430761.860317:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.860325:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.860333:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430761.860349:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.860389:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.860416:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.860431:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779840 00000100:00100000:3.0:1787430761.860436:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779840 00000100:00100000:3.0:1787430761.860531:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787430761.860540:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847779840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430761.860549:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430761.860560:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a940e9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.860589:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.860598:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.860624:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:3.0:1787430761.860654:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847779840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.860660:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787430761.860695:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430761.860705:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.860713:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430761.860754:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.860777:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.860794:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.860804:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847779968 00000100:00100000:3.0:1787430761.860807:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847779968 00000100:00100000:3.0:1787430761.860836:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787430761.860843:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847779968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.860919:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847779968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.860933:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787430761.860959:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847779968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.860981:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.861010:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.861022:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.861032:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780096 00000100:00100000:3.0:1787430761.861035:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780096 00000100:00100000:3.0:1787430761.861052:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787430761.861058:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847780096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.861118:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847780096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.861125:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787430761.861176:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430761.862645:0:13316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787430761.862781:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787430761.862810:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430761.862827:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430761.862838:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430761.862848:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787430761.862850:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c04f2d000 from 7 10000000:01000000:2.0:1787430761.862853:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430761.862877:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430761.862885:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430761.862894:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430761.862912:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430761.862953:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430761.862980:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430761.863101:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780224 00000100:00100000:0.0:1787430761.863107:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780224 00000100:00100000:0.0:1787430761.863183:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787430761.863192:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847780224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430761.863202:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430761.863213:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a940f7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430761.863230:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430761.863239:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430761.863253:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1c000, rc 0) 00000100:00100000:0.0:1787430761.863290:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847780224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430761.863296:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787430761.863357:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430761.863368:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430761.863376:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430761.863431:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430761.863513:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430761.863572:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.863618:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780352 00000100:00100000:3.0:1787430761.863622:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780352 00000100:00100000:3.0:1787430761.863641:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787430761.863648:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847780352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.863723:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847780352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.863729:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787430761.863767:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.863793:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.863842:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430761.863859:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aeec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430761.863869:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780480 00000100:00100000:3.0:1787430761.863872:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780480 00000100:00100000:3.0:1787430761.863888:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787430761.863893:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847780480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430761.863953:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847780480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430761.863960:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787430761.864009:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847780480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430761.864702:0:13317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787430761.864745:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787430761.864763:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430761.864771:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430761.864780:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1787430762.169589:0:13359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787430762.239841:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430762.239865:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847780608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430762.239934:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430762.240511:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780608 00000100:00100000:3.0:1787430762.240518:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780608 00000100:00100000:3.0:1787430762.240561:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787430762.240571:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847780608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430762.240628:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787430762.240671:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430762.240674:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847780608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430762.240680:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847780736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430762.240686:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787430762.240706:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430762.240777:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847780608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430762.240782:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847780864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430762.240830:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430762.240864:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780736 00000100:00100000:3.0:1787430762.240869:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780736 00000100:00100000:3.0:1787430762.240911:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780864 00000100:00100000:3.0:1787430762.240914:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780864 00000100:00100000:3.0:1787430762.240929:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430762.240953:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847780736:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430762.240964:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430762.240971:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847780864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430762.240973:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787430762.240980:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430762.241007:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847780736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430762.241007:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847780864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430762.241014:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787430762.241045:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d19c00 x1874256847780736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430762.241059:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847780736:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787430762.241082:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf3100 x1874256847780864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430762.241093:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847780864:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787430762.241146:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430762.241704:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:0.0:1787430762.496087:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430763.519919:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430763.520274:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430763.520313:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430763.520343:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430763.520357:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182144 00000100:00100000:3.0:1787430763.520368:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182144 00000100:00100000:1.0:1787430763.520378:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430763.520407:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430763.520425:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 315 00000100:00100000:3.0:1787430763.520437:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836182144:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430763.520516:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836182144:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430763.520525:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 315 00000100:00100000:0.0:1787430763.520666:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182400 00000100:00100000:0.0:1787430763.520672:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182400 00000100:00100000:0.0:1787430763.520717:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182656 00000100:00100000:0.0:1787430763.520720:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182656 00000100:00100000:0.0:1787430763.520734:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182272 00000100:00100000:0.0:1787430763.520736:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182272 00000100:00100000:0.0:1787430763.520749:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182528 00000100:00100000:0.0:1787430763.520752:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182528 00000100:00100000:0.0:1787430763.520766:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:0.0:1787430763.520774:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836182400:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430763.520821:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836182400:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 47us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430763.520830:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00080000:3.0:1787430763.520831:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430763.520839:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430763.520847:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:0.0:1787430763.520856:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836182656:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430763.520861:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:3.0:1787430763.520872:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836182272:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430763.520889:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836182656:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430763.520896:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:3.0:1787430763.520905:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836182272:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 34us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430763.520925:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:0.0:1787430763.520934:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836182528:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430763.521021:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836182528:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 88us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430763.522120:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:0.0:1787430763.522280:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:3.0:1787430763.532482:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430763.532520:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430763.532689:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182784 00000100:00100000:1.0:1787430763.532699:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182784 00000100:00100000:1.0:1787430763.532760:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836182912 00000100:00100000:1.0:1787430763.532763:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836182912 00000100:00100000:1.0:1787430763.532783:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:1.0:1787430763.532792:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2398:x1874256836182784:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:1.0:1787430763.532833:0:8830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a940aa 00000100:00080000:1.0:1787430763.532854:0:8830:0:(import.c:65:import_set_state_nolock()) ffff8e2b03ca4800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787430763.532895:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000001:00000004:1.0:1787430763.532898:0:8830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787430763.532909:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2398:x1874256836182912:12345-192.168.202.25@tcp:9:kworker.0 00010000:00010000:0.0:1787430763.532929:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787430763.532939:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a940b1 00000100:00080000:2.0:1787430763.532952:0:8409:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a75f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430763.533001:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787430763.533120:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+2:2398:x1874256836182784:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 327us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430763.533127:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1787430763.533235:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+2:2398:x1874256836182912:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 330us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430763.533243:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00010000:00010000:0.0:1787430763.533309:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430763.534377:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430763.534382:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430764.544777:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430764.799893:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847780992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430764.799956:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430764.800398:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847780992 00000100:00100000:1.0:1787430764.800407:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847780992 00000100:00100000:3.0:1787430764.800423:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847781120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430764.800451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430764.800480:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787430764.800491:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847781120 00000100:00100000:1.0:1787430764.800493:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847780992:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430764.800495:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847781120 00000100:00100000:3.0:1787430764.800521:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00002000:00000024:1.0:1787430764.800527:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430764.800528:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847781120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430764.800554:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430764.800623:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847781120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430764.800629:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787430764.800660:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430764.800669:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847781120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430764.800676:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847781248:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787430764.800709:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d1b480 x1874256847780992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430764.800721:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847780992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430764.800723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430764.800743:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847781248 00000100:00100000:3.0:1787430764.800746:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847781248 00000100:00080000:0.0:1787430764.800779:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430764.800780:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787430764.800800:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847781248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430764.800811:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430764.800850:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847781248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430764.800854:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787430764.803919:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03e55180 x1874256847781248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430764.803944:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847781248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430764.804134:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430764.804218:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847780992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3727us (4258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430764.804228:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787430764.804307:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430764.804321:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847781504:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.804372:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430764.805991:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847781504 00000100:00100000:1.0:1787430764.806000:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847781504 00000100:00100000:1.0:1787430764.806053:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787430764.806061:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847781504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430764.806155:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847781504:12345-0@lo:400:kworker.0 Request processed in 96us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430764.806161:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787430764.806203:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847781504:0@lo:400:kworker.0 00000100:00100000:0.0:1787430764.806291:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847781376:0@lo:400:kworker.0 00000100:00100000:0.0:1787430764.806356:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430764.806418:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847781376 00000100:00100000:3.0:1787430764.806422:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847781376 00000100:00100000:3.0:1787430764.806453:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787430764.806458:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847781376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.806492:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847781376:12345-0@lo:400:kworker.0 Request processed in 35us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430764.806496:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787430764.806550:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847781376:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.806682:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847781632:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.806725:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430764.806789:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847781632 00000100:00100000:0.0:1787430764.806803:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847781632 00000100:00100000:0.0:1787430764.806840:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787430764.806847:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847781632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430764.807137:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847781760:0@lo:400:kworker.0 00000100:00100000:1.0:1787430764.807168:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430764.807214:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847781760 00000100:00100000:1.0:1787430764.807218:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847781760 00000100:00100000:1.0:1787430764.807253:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787430764.807259:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847781760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430764.807294:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847781760:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430764.807300:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787430764.807327:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847781760:0@lo:400:kworker.0 00000100:00100000:0.0:1787430764.807415:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847781632:12345-0@lo:400:kworker.0 Request processed in 568us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430764.807422:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787430764.807511:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847781888:0@lo:400:kworker.0 00000100:00100000:1.0:1787430764.807537:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430764.807626:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847781888 00000100:00100000:0.0:1787430764.807630:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847781888 00000100:00100000:0.0:1787430764.807664:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787430764.807678:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847781888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.807939:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847781632:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.807967:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847782016:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.807993:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430764.808019:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782016 00000100:00100000:3.0:1787430764.808023:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782016 00000100:00100000:3.0:1787430764.808049:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787430764.808056:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847782016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.808090:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847782016:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430764.808097:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1787430764.808125:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf2680 x1874256847782016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430764.808136:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847782016:0@lo:400:kworker.0 00000100:00080000:3.0:1787430764.808168:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430764.808173:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430764.808340:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847782144:0@lo:400:kworker.0 00000100:00100000:2.0:1787430764.808384:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430764.808409:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430764.808415:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847782272:0@lo:400:kworker.0 00000100:00100000:2.0:1787430764.808434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430764.808453:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782144 00000100:00100000:2.0:1787430764.808455:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782144 00000100:00100000:2.0:1787430764.808476:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782272 00000100:00100000:2.0:1787430764.808483:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782272 00000100:00100000:2.0:1787430764.808498:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787430764.808502:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847782144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430764.808526:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847782144:12345-0@lo:400:kworker.0 Request processed in 24us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430764.808530:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787430764.808538:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787430764.808542:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847782272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430764.808555:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847782272:12345-0@lo:400:kworker.0 Request processed in 14us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430764.808558:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787430764.808572:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787430764.808583:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf3100 x1874256847782272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430764.808590:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847782272:0@lo:400:kworker.0 00010000:00080000:2.0:1787430764.808596:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf1500 x1874256847782144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430764.808616:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847782144:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.808829:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847782528:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.808847:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430764.808867:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430764.808871:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847782400:0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.808883:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430764.808896:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782528 00000100:00100000:3.0:1787430764.808898:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782528 00000100:00100000:3.0:1787430764.808914:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782400 00000100:00100000:3.0:1787430764.808916:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782400 00000100:00100000:3.0:1787430764.808925:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787430764.808929:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847782528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.808949:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847782528:12345-0@lo:400:kworker.0 Request processed in 20us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430764.808952:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787430764.808960:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787430764.808963:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847782400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430764.808977:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847782400:12345-0@lo:400:kworker.0 Request processed in 13us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430764.808980:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787430764.808997:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847782400:0@lo:400:kworker.0 00010000:00080000:3.0:1787430764.809003:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf1180 x1874256847782528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430764.809008:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847782528:0@lo:400:kworker.0 00000100:00100000:0.0:1787430764.809137:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847781888:12345-0@lo:400:kworker.0 Request processed in 1461us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430764.809142:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1787430764.809185:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430764.809187:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430764.809236:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847781888:0@lo:400:kworker.0 00000001:02000400:1.0:1787430765.393856:0:13507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:32:44 (1787430764) === 00000100:00100000:1.0:1787430765.550534:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430765.550743:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836183040 00000100:00100000:2.0:1787430765.550753:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836183040 00000100:00080000:0.0:1787430765.550813:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430765.550861:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:2.0:1787430765.550873:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:10482:x1874256836183040:12345-192.168.202.25@tcp:700:mkdir.0 00000100:00100000:2.0:1787430765.550954:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:10482:x1874256836183040:12345-192.168.202.25@tcp:700:mkdir.0 Request processed in 85us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430765.550976:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1787430765.551967:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.552001:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836183296 00000100:00100000:3.0:1787430765.552006:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836183296 00000100:00100000:3.0:1787430765.552079:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:3.0:1787430765.552086:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:10482:x1874256836183296:12345-192.168.202.25@tcp:36:mkdir.0 00010000:00010000:3.0:1787430765.552123:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430765.552145:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1ce00/0x4dbb683ba6a93fa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138763 expref: 6 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552159:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b32500) 00010000:00010000:3.0:1787430765.552166:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430765.552239:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552249:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552255:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552297:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552302:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552306:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552737:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552751:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552756:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430765.552767:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f28483e reply state 00000000ec72a042 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552774:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552780:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430765.552796:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430765.552800:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787430765.552804:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787430765.552810:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552817:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552824:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552830:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430765.552835:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552842:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552855:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:3.0:1787430765.552857:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430765.552859:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552864:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94105 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430765.552873:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f28483e reply state 00000000ec72a042 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552877:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.552881:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2c132d1900) 00010000:00010000:3.0:1787430765.552882:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430765.552883:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787430765.552946:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:10482:x1874256836183296:12345-192.168.202.25@tcp:36:mkdir.0 Request processed in 860us (981us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787430765.552951:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:3.0:1787430765.559297:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.559362:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836183424 00000100:00100000:0.0:1787430765.559373:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836183424 00000100:00100000:0.0:1787430765.559489:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1787430765.559500:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:10483:x1874256836183424:12345-192.168.202.25@tcp:101:chmod.0 00010000:00010000:0.0:1787430765.559521:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430765.559542:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d200/0x4dbb683ba6a9411a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91387f6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.559638:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a94121 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.559651:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a94121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.559663:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a94121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430765.559708:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430765.559712:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430765.559747:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a94121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.559773:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d200/0x4dbb683ba6a9411a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387f6 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.559823:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a94121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387f6 expref: 8 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.559833:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33500) 00010000:00010000:0.0:1787430765.559835:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430765.559839:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1cc00, rc 0) 00000100:00100000:0.0:1787430765.559900:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:10483:x1874256836183424:12345-192.168.202.25@tcp:101:chmod.0 Request processed in 401us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430765.559907:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:1.0:1787430765.561571:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430765.561680:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836183680 00000100:00100000:2.0:1787430765.561688:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836183680 00000100:00100000:2.0:1787430765.561731:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:2.0:1787430765.561740:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:10483:x1874256836183680:12345-192.168.202.25@tcp:36:chmod.0 00010000:00010000:2.0:1787430765.561777:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430765.561868:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a94121 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387f6 expref: 8 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.561884:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33500) 00010000:00010000:2.0:1787430765.561892:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430765.561913:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.561922:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.561931:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430765.562247:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa530ef3 reply state 000000001db9eaa6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.562259:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.562265:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493b00) 00010000:00010000:2.0:1787430765.562267:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787430765.562270:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787430765.562284:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787430765.562352:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:10483:x1874256836183680:12345-192.168.202.25@tcp:36:chmod.0 Request processed in 612us (785us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787430765.562359:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00010000:00010000:3.0:1787430765.568026:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430765.573555:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.573680:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836183808 00000100:00100000:3.0:1787430765.573692:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836183808 00000100:00100000:3.0:1787430765.573811:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1787430765.573822:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:10484:x1874256836183808:12345-192.168.202.25@tcp:101:chown.0 00010000:00010000:3.0:1787430765.573849:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430765.573869:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9412f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91387fd expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.573950:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea200/0x4dbb683ba6a94136 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.573965:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea200/0x4dbb683ba6a94136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.573976:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea200/0x4dbb683ba6a94136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430765.574017:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787430765.574022:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430765.574060:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea200/0x4dbb683ba6a94136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.574087:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9412f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387fd expref: 11 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.574104:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea200/0x4dbb683ba6a94136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387fd expref: 10 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.574113:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493b00) 00010000:00010000:3.0:1787430765.574116:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430765.574120:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013ea200, rc 0) 00000100:00100000:3.0:1787430765.574178:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:10484:x1874256836183808:12345-192.168.202.25@tcp:101:chown.0 Request processed in 357us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430765.574196:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1787430765.575380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.575425:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836183936 00000100:00100000:0.0:1787430765.575432:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836183936 00000100:00100000:0.0:1787430765.575519:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:0.0:1787430765.575539:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:10484:x1874256836183936:12345-192.168.202.25@tcp:101:chown.0 00010000:00010000:0.0:1787430765.575553:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430765.575568:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d200/0x4dbb683ba6a9413d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138804 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575641:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575652:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575662:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575673:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575688:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575695:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575763:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575778:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575795:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430765.575828:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430765.575832:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430765.575848:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575856:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575860:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575865:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575868:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1dc00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430765.575872:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575881:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575890:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493b00) 00010000:00010000:0.0:1787430765.575892:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430765.575895:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575899:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a94144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575908:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575912:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575916:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575919:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430765.575920:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575923:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575927:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2c132d1900) 00010000:00010000:0.0:1787430765.575928:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430765.575930:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575938:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9414b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575954:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d200/0x4dbb683ba6a9413d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138804 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575961:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138804 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.575966:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:0.0:1787430765.575968:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430765.575969:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d600, rc 0) 00000100:00100000:0.0:1787430765.575998:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:10484:x1874256836183936:12345-192.168.202.25@tcp:101:chown.0 Request processed in 464us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430765.576003:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:1.0:1787430765.577462:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.577680:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836184064 00000100:00100000:0.0:1787430765.577686:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836184064 00000100:00100000:0.0:1787430765.577755:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1787430765.577762:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:10484:x1874256836184064:12345-192.168.202.25@tcp:900:chown.0 00000100:00100000:0.0:1787430765.577839:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:10484:x1874256836184064:12345-192.168.202.25@tcp:900:chown.0 Request processed in 76us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430765.577845:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1787430765.579028:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430765.579088:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836184320 00000100:00100000:2.0:1787430765.579093:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836184320 00000100:00100000:2.0:1787430765.579126:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:2.0:1787430765.579132:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:10484:x1874256836184320:12345-192.168.202.25@tcp:36:chown.0 00010000:00010000:2.0:1787430765.579164:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430765.579183:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94152 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138804 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.579205:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:2.0:1787430765.579209:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430765.579224:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.579233:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.579238:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430765.581300:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1787430765.581373:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581382:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581387:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581397:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430765.581400:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581404:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581414:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2c132d1900) 00010000:00010000:2.0:1787430765.581415:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430765.581418:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581421:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9410c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581435:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581439:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581442:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581445:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c013ea000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430765.581447:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581450:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581460:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:2.0:1787430765.581462:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430765.581463:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581466:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a94113 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581532:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581539:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581544:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581549:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430765.581552:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581557:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581566:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493b00) 00010000:00010000:2.0:1787430765.581569:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430765.581571:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430765.581577:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94128 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430765.581759:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0b3f19a reply state 000000001fe8bc62 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.581838:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.581843:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430765.581844:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787430765.581847:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787430765.581855:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1787430765.581948:0:6498:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787430765.581964:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:10484:x1874256836184320:12345-192.168.202.25@tcp:36:chown.0 Request processed in 2829us (2936us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787430765.581969:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00010000:00010000:0.0:1787430765.582031:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.582036:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.582047:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.582050:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430765.582052:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.582055:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.582061:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:0.0:1787430765.582062:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787430765.582063:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.582067:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94159 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430765.589728:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.589917:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836184448 00000100:00100000:3.0:1787430765.589926:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836184448 00000100:00100000:3.0:1787430765.589998:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1787430765.590006:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:10485:x1874256836184448:12345-192.168.202.25@tcp:101:touch.500 00010000:00010000:3.0:1787430765.590026:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430765.590040:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a94160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913880b expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430765.591264:0:10098:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1188us 00010000:00010000:3.0:1787430765.598090:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598114:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598128:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598145:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598160:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598169:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598287:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eaa00/0x4dbb683ba6a94175 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598296:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eaa00/0x4dbb683ba6a94175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598304:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eaa00/0x4dbb683ba6a94175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430765.598333:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787430765.598337:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430765.598384:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eaa00/0x4dbb683ba6a94175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598476:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598483:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598490:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598497:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c013ebc00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430765.598501:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598515:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598527:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493b00) 00010000:00010000:3.0:1787430765.598530:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430765.598535:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598541:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a94167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598553:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598559:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598566:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598571:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c013eb400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430765.598573:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598579:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598586:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2c132d1d00) 00010000:00010000:3.0:1787430765.598588:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430765.598591:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598648:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a9416e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598689:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a94160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913880b expref: 8 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598704:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eaa00/0x4dbb683ba6a94175 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913880b expref: 7 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.598711:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:3.0:1787430765.598714:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787430765.598717:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013eaa00, rc 0) 00000100:00100000:3.0:1787430765.598795:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:10485:x1874256836184448:12345-192.168.202.25@tcp:101:touch.500 Request processed in 8780us (9266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430765.598803:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1787430765.602104:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.602182:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836184704 00000100:00100000:0.0:1787430765.602191:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836184704 00000100:00100000:0.0:1787430765.602253:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1787430765.602264:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:10485:x1874256836184704:12345-192.168.202.25@tcp:101:touch.500 00010000:00010000:0.0:1787430765.602283:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430765.602301:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d200/0x4dbb683ba6a9417c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138812 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.602392:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.602406:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.602426:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.602474:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.602482:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.602488:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787430765.603066:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787430765.603180:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1da00/0x4dbb683ba6a94191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603187:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1da00/0x4dbb683ba6a94191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603192:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1da00/0x4dbb683ba6a94191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603222:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603227:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603231:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603235:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430765.603243:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603248:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603256:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:0.0:1787430765.603258:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430765.603261:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603265:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a94183 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430765.603273:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dea7c03d reply state 00000000402b5c30 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603279:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603282:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff8e2b03b33e00) 00010000:00010000:0.0:1787430765.603284:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430765.603286:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787430765.603305:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d200/0x4dbb683ba6a9417c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138812 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603313:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1da00/0x4dbb683ba6a94191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138812 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.603317:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2b03b33500) 00010000:00010000:0.0:1787430765.603319:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430765.603324:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1da00, rc 0) 00000100:00100000:0.0:1787430765.603374:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:10485:x1874256836184704:12345-192.168.202.25@tcp:101:touch.500 Request processed in 1112us (1278us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787430765.603380:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:1.0:1787430765.606074:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.606146:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836184960 00000100:00100000:3.0:1787430765.606154:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836184960 00000100:00100000:3.0:1787430765.606218:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:3.0:1787430765.606226:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:10485:x1874256836184960:12345-192.168.202.25@tcp:36:touch.500 00010000:00010000:3.0:1787430765.606268:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430765.606287:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1da00/0x4dbb683ba6a94191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138812 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.606298:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2b03b33500) 00010000:00010000:3.0:1787430765.606304:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430765.606340:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.606356:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.606363:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430765.606435:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b29f8b0d reply state 0000000046e53db6 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.606443:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.606447:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:3.0:1787430765.606449:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430765.606450:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430765.606509:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:10485:x1874256836184960:12345-192.168.202.25@tcp:36:touch.500 Request processed in 285us (442us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787430765.606514:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1787430765.607484:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.607541:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836185088 00000100:00100000:3.0:1787430765.607546:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836185088 00000100:00100000:3.0:1787430765.607683:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:3.0:1787430765.607690:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:10485:x1874256836185088:12345-192.168.202.25@tcp:101:touch.500 00010000:00010000:3.0:1787430765.607701:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430765.607711:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a941a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138819 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.607735:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a941a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138819 expref: 12 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.607755:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a941a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138819 expref: 12 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.607791:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:3.0:1787430765.607795:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430765.607797:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013eb400, rc 0) 00000100:00100000:3.0:1787430765.607829:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:10485:x1874256836185088:12345-192.168.202.25@tcp:101:touch.500 Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430765.607833:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:1.0:1787430765.610533:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.610598:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836185216 00000100:00100000:3.0:1787430765.610657:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836185216 00000100:00100000:3.0:1787430765.610718:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1787430765.610724:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874256836185216:12345-192.168.202.25@tcp:8:touch.500 00010000:00080000:3.0:1787430765.610748:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1787430765.610809:0:8408:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a941ad 00002000:00100000:3.0:1787430765.610820:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 419b0c27-15f9-4e73-995a-bc02788ae1b0/ffff8e2b03e91000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787430765.610833:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787430765.610890:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787430765.610912:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8e2b03e90800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430765.610950:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836185216:12345-192.168.202.25@tcp:8:touch.500 Request processed in 226us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430765.610955:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1787430765.612000:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430765.612059:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836185344 00000100:00100000:2.0:1787430765.612063:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836185344 00000100:00100000:2.0:1787430765.612138:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:2.0:1787430765.612145:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836185344:12345-192.168.202.25@tcp:2:touch.500 00000100:00080000:0.0:1787430765.612478:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787430765.613140:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1787430765.613146:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000001:00100000:3.0:1787430765.613154:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00000020:00000080:3.0:1787430765.613156:0:8404:0:(genops.c:885:class_export_put()) final put ffff8e2b03ca3800/a623e317-dfe7-4c7d-8620-46d6b83d3031 00000020:00000080:1.0:1787430765.613203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03ca3800/a623e317-dfe7-4c7d-8620-46d6b83d3031 for lustre-OST0000 00000020:00000080:1.0:1787430765.613231:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03ca4800 for lustre-OST0000 00000100:00100000:2.0:1787430765.613344:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:0:x1874256836185344:12345-192.168.202.25@tcp:2:touch.500 Request processed in 1198us (1346us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787430765.613349:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:1.0:1787430765.614575:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430765.614675:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836185600 00000100:00100000:2.0:1787430765.614681:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836185600 00000100:00100000:2.0:1787430765.614717:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:2.0:1787430765.614723:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:10485:x1874256836185600:12345-192.168.202.25@tcp:35:touch.500 00000100:00100000:2.0:1787430765.615007:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:10485:x1874256836185600:12345-192.168.202.25@tcp:35:touch.500 Request processed in 283us (436us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787430765.615012:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1787430765.620995:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.621064:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836185728 00000100:00100000:0.0:1787430765.621072:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836185728 00000100:00100000:0.0:1787430765.621182:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:0.0:1787430765.621191:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:10486:x1874256836185728:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:0.0:1787430765.621213:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430765.621229:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a941b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138820 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.621287:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a941bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.621298:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a941bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.621306:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a941bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430765.621341:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430765.621343:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430765.621370:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a941bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.621396:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a941b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138820 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.621417:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a941bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138820 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.621423:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:0.0:1787430765.621425:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430765.621427:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1cc00, rc 0) 00000100:00100000:0.0:1787430765.621497:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:10486:x1874256836185728:12345-192.168.202.25@tcp:101:rm.0 Request processed in 308us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430765.621501:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:0.0:1787430765.623433:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.623499:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836185984 00000100:00100000:3.0:1787430765.623506:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836185984 00000100:00100000:3.0:1787430765.623578:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:3.0:1787430765.623589:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:10486:x1874256836185984:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:3.0:1787430765.623648:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430765.623665:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a941c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138827 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430765.623738:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787430765.623843:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a941c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138827 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.623854:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493b00) 00010000:00010000:3.0:1787430765.623856:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430765.623859:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a941c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138827 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.623870:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013ebc00, rc 0) 00000100:00100000:3.0:1787430765.623912:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:10486:x1874256836185984:12345-192.168.202.25@tcp:101:rm.0 Request processed in 327us (486us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1787430765.623917:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1787430765.626485:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.626551:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836186112 00000100:00100000:0.0:1787430765.626560:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836186112 00000100:00100000:2.0:1787430765.626706:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1787430765.626716:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:10486:x1874256836186112:12345-192.168.202.25@tcp:37:rm.0 00000100:00100000:2.0:1787430765.632580:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:10486:x1874256836186112:12345-192.168.202.25@tcp:37:rm.0 Request processed in 5855us (6089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430765.632594:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:1.0:1787430765.635020:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.635097:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836186368 00000100:00100000:0.0:1787430765.635105:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836186368 00000100:00100000:0.0:1787430765.635148:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:0.0:1787430765.635350:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e58050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:10486:x1874256836186368:12345-192.168.202.25@tcp:35:rm.0 00000100:00100000:0.0:1787430765.635631:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e58050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:10486:x1874256836186368:12345-192.168.202.25@tcp:35:rm.0 Request processed in 444us (584us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787430765.635639:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1787430765.637166:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.637347:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836186624 00000100:00100000:3.0:1787430765.637354:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836186624 00000100:00100000:3.0:1787430765.637422:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:3.0:1787430765.637429:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:10486:x1874256836186624:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:3.0:1787430765.637460:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430765.637478:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a941d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913882e expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.637555:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea800/0x4dbb683ba6a941d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.637568:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea800/0x4dbb683ba6a941d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.637579:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea800/0x4dbb683ba6a941d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430765.637590:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787430765.637695:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ebc00/0x4dbb683ba6a941d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913882e expref: 19 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.637708:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea800/0x4dbb683ba6a941d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913882e expref: 18 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.637714:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:3.0:1787430765.637716:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430765.637718:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c013ea800, rc 0) 00000100:00100000:3.0:1787430765.637748:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:10486:x1874256836186624:12345-192.168.202.25@tcp:101:rm.0 Request processed in 320us (589us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787430765.637753:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:1.0:1787430765.640304:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.640400:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836186752 00000100:00100000:0.0:1787430765.640410:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836186752 00000100:00100000:0.0:1787430765.640465:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:0.0:1787430765.640475:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:10486:x1874256836186752:12345-192.168.202.25@tcp:41:rm.0 00000004:00000024:0.0:1787430765.640595:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787430765.640917:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:10486:x1874256836186752:12345-192.168.202.25@tcp:41:rm.0 Request processed in 443us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430765.640939:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:1.0:1787430765.642574:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430765.642707:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836186880 00000100:00100000:3.0:1787430765.642713:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836186880 00000100:00100000:3.0:1787430765.642781:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1787430765.642829:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:10486:x1874256836186880:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:3.0:1787430765.642846:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430765.642865:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a941e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138835 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.642920:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.642931:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.642939:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.642946:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.642951:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.642954:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643016:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a941fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643021:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a941fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643024:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a941fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430765.643057:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787430765.643060:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430765.643072:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a941fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643080:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a941fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643085:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643089:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643093:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643097:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430765.643099:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643103:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643111:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:3.0:1787430765.643113:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430765.643116:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643120:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a941ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643133:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643137:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643140:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643143:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430765.643145:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643148:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643152:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff8e2b03b33e00) 00010000:00010000:3.0:1787430765.643154:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430765.643156:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643161:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a941f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643183:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea000/0x4dbb683ba6a941e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138835 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643195:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a941fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138835 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430765.643219:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:3.0:1787430765.643221:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430765.643223:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491400, rc 0) 00000100:00100000:3.0:1787430765.643291:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:10486:x1874256836186880:12345-192.168.202.25@tcp:101:rm.0 Request processed in 466us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430765.643296:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1787430765.644965:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430765.645026:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836187136 00000100:00100000:1.0:1787430765.645033:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836187136 00000100:00100000:1.0:1787430765.645069:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:1.0:1787430765.645076:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:10486:x1874256836187136:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:1.0:1787430765.645109:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787430765.645125:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a941fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138835 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645139:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb400/0x4dbb683ba6a941a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138819 expref: 18 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645147:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:1.0:1787430765.645153:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1cc00/0x4dbb683ba6a941bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138820 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645161:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:1.0:1787430765.645164:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430765.645179:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645190:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645219:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645228:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645233:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645237:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645295:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645299:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645303:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430765.645456:0:10098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787430765.645463:0:10098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 227117861370ns, next at 228117859955ns, rc = 0 00010000:00010000:1.0:1787430765.645494:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645500:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645504:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645516:0:10098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645850:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645860:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645912:0:10098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430765.645929:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645934:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645937:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645941:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eee00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430765.645944:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645948:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645953:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:1.0:1787430765.645955:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787430765.645957:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645967:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a9420f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645977:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645980:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645984:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645986:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430765.645989:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.645994:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.646002:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:1.0:1787430765.646003:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430765.646006:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.646011:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef200/0x4dbb683ba6a94201 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430765.646019:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d4fc985 reply state 00000000f1e599fa transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.646029:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430765.646040:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff8e2b03b33e00) 00010000:00010000:1.0:1787430765.646042:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787430765.646045:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430765.646109:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:10486:x1874256836187136:12345-192.168.202.25@tcp:36:rm.0 Request processed in 1031us (1148us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787430765.646116:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00010000:00010000:0.0:1787430765.646861:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430765.646868:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.646875:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430765.646879:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.646885:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.646896:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:0.0:1787430765.646898:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787430765.646901:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.646907:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee200/0x4dbb683ba6a94216 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.646917:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430765.646919:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430765.646920:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430765.649268:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430765.649404:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836187392 00000100:00100000:2.0:1787430765.649413:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836187392 00000100:00100000:2.0:1787430765.649464:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1787430765.649473:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:10486:x1874256836187392:12345-192.168.202.25@tcp:35:rm.0 00000100:00100000:2.0:1787430765.653125:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:10486:x1874256836187392:12345-192.168.202.25@tcp:35:rm.0 Request processed in 3644us (3857us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787430765.653146:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1787430765.654972:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430765.655061:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836187648 00000100:00100000:0.0:1787430765.655070:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836187648 00000100:00100000:0.0:1787430765.655157:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:0.0:1787430765.655168:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:10486:x1874256836187648:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:0.0:1787430765.655229:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787430765.655253:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea800/0x4dbb683ba6a941d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913882e expref: 19 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655289:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eaa00/0x4dbb683ba6a94175 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913880b expref: 18 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655298:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2c132d1300) 00010000:00010000:0.0:1787430765.655312:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013ea200/0x4dbb683ba6a94136 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387fd expref: 17 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655319:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493b00) 00010000:00010000:0.0:1787430765.655325:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430765.655346:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655356:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655364:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655374:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655380:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655385:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655451:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655467:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655473:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430765.655709:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787430765.655723:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655731:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655737:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655743:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1c800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430765.655747:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655754:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655763:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2b03b33100) 00010000:00010000:0.0:1787430765.655765:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787430765.655778:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655792:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a9422b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655808:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655820:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655826:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655831:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430765.655834:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655841:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655849:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33b00) 00010000:00010000:0.0:1787430765.655851:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430765.655854:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655860:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a9421d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430765.655871:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000797ded6d reply state 00000000692d0c17 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655884:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430765.655890:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2b03b33000) 00010000:00010000:0.0:1787430765.655892:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430765.655895:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430765.655950:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:10486:x1874256836187648:12345-192.168.202.25@tcp:36:rm.0 Request processed in 784us (984us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787430765.655963:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00010000:00010000:1.0:1787430766.592757:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787430767.362233:0:8826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 228834628475ns, next at 229834626173ns, rc = 0 00000100:00100000:2.0:1787430767.362264:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847782784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430767.362328:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430767.362396:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430767.362403:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847782656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430767.362427:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430767.362661:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782784 00000100:00100000:1.0:1787430767.362671:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782784 00000100:00100000:3.0:1787430767.363046:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782656 00000100:00100000:3.0:1787430767.363052:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782656 00000100:00100000:0.0:1787430767.363098:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847782912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430767.363117:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787430767.363128:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847782784:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430767.363131:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787430767.363152:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430767.363168:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847782912 00000100:00100000:0.0:1787430767.363172:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847782912 00000100:00100000:0.0:1787430767.363198:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787430767.363205:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847782912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430767.363213:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847782784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430767.363220:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00000024:0.0:1787430767.363226:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00010000:00080000:1.0:1787430767.363306:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d88700 x1874256847782784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430767.363325:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847782784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430767.363380:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847782912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430767.363386:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787430767.363423:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847782912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430767.363515:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787430767.363838:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847782656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787430767.363851:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430767.363938:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847782656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 416us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430767.363944:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787430767.363995:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03ff4700 x1874256847782656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430767.364009:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847782656:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787430767.365054:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430767.615795:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430767.919450:0:13655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:0.0:1787430768.495005:0:13703:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd17327c0 20000000:00000080:0.0:1787430768.495018:0:13703:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2b04863000 uarg=0000000000000000 20000000:01000000:0.0:1787430768.495049:0:13703:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787430768.495054:0:13703:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787430768.495057:0:13703:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787430768.495649:0:13704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787430768.495712:0:13703:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787430768.499227:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787430768.499260:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787430768.499283:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787430768.499294:0:13703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787430768.499310:0:13703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499334:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499340:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499345:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499349:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499353:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499357:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499361:0:13703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499392:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499403:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430768.499421:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783040:0@lo:104: 00000100:00100000:1.0:1787430768.499474:0:13703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430768.499535:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499544:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430768.499552:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783168:0@lo:104: 00000100:00100000:3.0:1787430768.499553:0:10312:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787430768.499566:0:10312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847783040 00000100:00100000:1.0:1787430768.499571:0:13703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430768.499573:0:10312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847783040 00010000:00010000:1.0:1787430768.499621:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499631:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430768.499637:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847783168 00000100:00100000:1.0:1787430768.499639:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783296:0@lo:104: 00000100:00100000:0.0:1787430768.499641:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847783168 00000100:00100000:1.0:1787430768.499659:0:13703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430768.499688:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499695:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 23 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430768.499702:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783424:0@lo:104: 00000100:00100000:1.0:1787430768.499720:0:13703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430768.499736:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499753:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 12 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430768.499778:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783552:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430768.499829:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.499837:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 12 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430768.499844:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783680:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430768.499863:0:13703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10f98180 going to sleep for 11 seconds 00000100:00100000:2.0:1787430768.499894:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847783296 00000100:00100000:2.0:1787430768.499898:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847783296 00000100:00100000:3.0:1787430768.499965:0:10312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847783424 00000100:00100000:3.0:1787430768.499969:0:10312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847783424 00000100:00100000:0.0:1787430768.500389:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787430768.500401:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:13703:x1874256847783040:12345-0@lo:104: 00010000:00010000:0.0:1787430768.500416:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430768.500441:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787430768.500449:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:13703:x1874256847783168:12345-0@lo:104: 00010000:00010000:2.0:1787430768.500456:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500495:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430768.500503:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:13703:x1874256847783040:12345-0@lo:104: Request processed in 104us (1027us total) trans 0 rc 0/0 00010000:00010000:2.0:1787430768.500505:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787430768.500513:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+6:13703:x1874256847783168:12345-0@lo:104: Request processed in 66us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430768.500513:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783040:0@lo:104: 00000100:00100000:0.0:1787430768.500516:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430768.500525:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787430768.500526:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783168:0@lo:104: 00000100:00100000:2.0:1787430768.500555:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787430768.500563:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:13703:x1874256847783296:12345-0@lo:104: 00010000:00010000:2.0:1787430768.500569:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500570:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430768.500579:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500595:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430768.500618:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500628:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430768.500641:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.500646:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787430768.500648:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1787430768.500648:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787430768.500655:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+4:13703:x1874256847783296:12345-0@lo:104: Request processed in 91us (993us total) trans 0 rc 0/0 00010000:00010000:1.0:1787430768.500655:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.500663:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc144ec20) 00000100:00100000:2.0:1787430768.500664:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 10000000:00010000:1.0:1787430768.500666:0:10373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.500674:0:10373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.500682:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787430768.500685:0:10373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500685:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.500686:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500704:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430768.500705:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8aa00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430768.500710:0:10372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430768.500714:0:10373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787430768.500718:0:10372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430768.500725:0:10372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500726:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.500731:0:10373:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430768.500738:0:10372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430768.500746:0:10373:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430768.500747:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03400/0x4dbb683ba6a940f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.500752:0:10372:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.500771:0:10372:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430768.500776:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.500779:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.500789:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a940db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.500789:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8be00/0x4dbb683ba6a940e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.500790:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430768.500794:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430768.500797:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430768.500805:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430768.500808:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430768.500810:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430768.500810:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430768.500812:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430768.500814:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847783808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430768.500816:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430768.500823:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847784064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430768.500849:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430768.500947:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847783808 00000100:00100000:2.0:1787430768.500951:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847783808 00010000:00010000:2.0:1787430768.500969:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 24 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430768.500990:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787430768.500997:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847783808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430768.501005:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430768.501009:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 24 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.501019:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 24 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.501031:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1c000/0x4dbb683ba6a940fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a940f7 expref: 24 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.501040:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430768.501067:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3630:x1874256847783808:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430768.501073:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787430768.501100:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847783808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430768.501152:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783296:0@lo:104: 00000100:00100000:0.0:1787430768.501263:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847783936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430768.501301:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430768.501326:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784064 00000100:00100000:0.0:1787430768.501331:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784064 00010000:00010000:0.0:1787430768.501349:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430768.501374:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787430768.501382:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3628:x1874256847784064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430768.501390:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430768.501394:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.501404:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430768.501412:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430768.501422:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8b600/0x4dbb683ba6a940e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a940db expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.501432:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430768.501458:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847783936 00000100:00100000:1.0:1787430768.501464:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847783936 00000100:00100000:0.0:1787430768.501471:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3628:x1874256847784064:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430768.501478:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1787430768.501482:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 23 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430768.501506:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787430768.501514:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3627:x1874256847783936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430768.501523:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430768.501528:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 22 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.501536:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 22 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.501546:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ac00/0x4dbb683ba6a940f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a940e9 expref: 22 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.501554:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430768.501584:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3627:x1874256847783936:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430768.501590:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787430768.501632:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847783936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430768.501659:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847784064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430768.501707:0:10312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787430768.501713:0:10312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:13703:x1874256847783424:12345-0@lo:104: 00010000:00010000:3.0:1787430768.501719:0:10312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430768.501795:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783424:0@lo:104: 00010000:00010000:3.0:1787430768.501809:0:10312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430768.501820:0:10312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+3:13703:x1874256847783424:12345-0@lo:104: Request processed in 107us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430768.501826:0:10312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1787430768.501897:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430768.501902:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.501909:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430768.502066:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.502080:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430768.502084:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430768.502088:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430768.502108:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.502114:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430768.502136:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430768.502141:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847784192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430768.502143:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b800/0x4dbb683ba6a940cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a940d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.502156:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430768.502157:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430768.502159:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430768.502166:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430768.502264:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784192 00000100:00100000:0.0:1787430768.502269:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784192 00010000:00010000:0.0:1787430768.502287:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 21 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430768.502309:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430768.502316:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3629:x1874256847784192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430768.502323:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430768.502327:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 21 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.502335:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 21 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.502350:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1d800/0x4dbb683ba6a940d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a940cd expref: 21 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.502358:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430768.502388:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3629:x1874256847784192:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430768.502394:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787430768.502414:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847784192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430768.503071:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783552:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430768.503081:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1874256847783680:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430768.503106:0:13703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430768.503165:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430768.503220:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430768.503299:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836187776 00000100:00100000:3.0:1787430768.503304:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836187776 00000100:00100000:2.0:1787430768.503351:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836187904 00000100:00100000:2.0:1787430768.503356:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836187904 00010000:00010000:2.0:1787430768.503371:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 14 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430768.503401:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:2.0:1787430768.503408:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:71807ffe-f1d6-4473-b7d7-5788186ad6db+14:2400:x1874256836187904:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430768.503417:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430768.503422:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 14 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.503431:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 14 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.503442:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360eea00/0x4dbb683ba6a940bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387e8 expref: 14 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430768.503451:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430768.503493:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836187904:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430768.503500:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00010000:00010000:3.0:1787430768.503595:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 12 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430768.503706:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1787430768.503714:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:2399:x1874256836187776:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430768.503722:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430768.503727:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 12 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503736:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 12 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503747:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8a400/0x4dbb683ba6a940c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387ef expref: 12 pid: 6492 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503770:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503779:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503792:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503799:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503815:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503822:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503907:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430768.503910:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503955:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503967:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430768.503976:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430768.503987:0:13703:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.503994:0:13703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430768.504001:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ee200/0x4dbb683ba6a94232 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430768.504006:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:2399:x1874256836187776:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 293us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430768.504012:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:0.0:1787430768.637527:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430768.637581:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430768.637778:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430768.637798:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188160 00000100:00100000:3.0:1787430768.637806:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188160 00000100:00100000:3.0:1787430768.637865:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188032 00000100:00100000:3.0:1787430768.637868:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188032 00000100:00100000:3.0:1787430768.637888:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:3.0:1787430768.637906:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836188160:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430768.637967:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836188160:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 72us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430768.637989:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:3.0:1787430768.638016:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:3.0:1787430768.638022:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2402:x1874256836188032:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430768.638046:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2402:x1874256836188032:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430768.638052:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00080000:3.0:1787430768.638677:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430768.638682:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787430768.639853:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430768.640286:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188416 00000100:00100000:1.0:1787430768.640293:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188416 00000100:00100000:0.0:1787430768.640294:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430768.640328:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430768.640333:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:1.0:1787430768.640341:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836188416:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430768.640345:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188544 00000100:00100000:0.0:1787430768.640348:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188544 00000100:00100000:1.0:1787430768.640382:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836188416:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 41us (2603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430768.640398:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:1.0:1787430768.640414:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:1.0:1787430768.640421:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836188544:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430768.640445:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836188544:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430768.640451:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:2.0:1787430768.640504:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188288 00000100:00100000:2.0:1787430768.640508:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188288 00000100:00080000:3.0:1787430768.640509:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430768.640513:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430768.640549:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1787430768.640557:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836188288:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430768.640582:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836188288:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430768.640588:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00080000:1.0:1787430768.640798:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787430768.970081:0:13752:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8485e100 20000000:00000080:1.0:1787430768.970097:0:13752:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2c3639c000 uarg=0000000000000000 20000000:01000000:1.0:1787430768.970187:0:13752:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787430768.970305:0:13752:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787430768.970310:0:13752:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1787430768.970770:0:13753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1787430768.970879:0:13752:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1787430768.970938:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1787430768.970964:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1787430768.970977:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1787430768.970986:0:13752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787430768.971006:0:13752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971021:0:13752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971032:0:13752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971040:0:13752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971059:0:13752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971067:0:13752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971073:0:13752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430768.971078:0:13752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971087:0:13752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971101:0:13752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971108:0:13752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430768.971116:0:13752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a94239 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787430769.412889:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00000020:00000080:0.0:1787430769.412898:0:9485:0:(genops.c:885:class_export_put()) final put ffff8e2c3a75a800/a623e317-dfe7-4c7d-8620-46d6b83d3031 00000020:00000080:3.0:1787430769.412964:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a75a800/a623e317-dfe7-4c7d-8620-46d6b83d3031 for lustre-OST0001 00000020:00000080:3.0:1787430769.413133:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3a75f000 for lustre-OST0001 00010000:00010000:1.0:1787430769.666324:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430769.789701:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430769.789871:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188672 00000100:00100000:0.0:1787430769.789883:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188672 00000100:00100000:0.0:1787430769.790012:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 317 00000100:00100000:0.0:1787430769.790027:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:6162:x1874256836188672:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430769.790048:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430769.790072:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1da00/0x4dbb683ba6a94240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913883c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.790107:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1da00/0x4dbb683ba6a94240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913883c expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.790120:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1da00/0x4dbb683ba6a94240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913883c expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.790132:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1da00, rc 0) 00000100:00100000:0.0:1787430769.790202:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836188672:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 179us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430769.790209:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 317 00000100:00100000:2.0:1787430769.793104:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430769.794660:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188800 00000100:00100000:3.0:1787430769.794673:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188800 00000100:00100000:3.0:1787430769.794742:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 318 00000100:00100000:3.0:1787430769.794762:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836188800:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430769.794936:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836188800:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 175us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.794944:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 318 00000100:00100000:1.0:1787430769.797712:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430769.797869:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836188928 00000100:00100000:3.0:1787430769.797880:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836188928 00000100:00100000:3.0:1787430769.797955:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 319 00000100:00100000:3.0:1787430769.797966:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836188928:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430769.798143:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836188928:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 179us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.798160:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 319 00000100:00100000:1.0:1787430769.802146:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430769.803271:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189056 00000100:00100000:0.0:1787430769.803289:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189056 00000100:00100000:0.0:1787430769.803366:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 320 00000100:00100000:0.0:1787430769.803377:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:10769:x1874256836189056:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430769.803557:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:10769:x1874256836189056:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 181us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430769.803566:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 320 00000100:00100000:2.0:1787430769.812708:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430769.812813:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189184 00000100:00100000:3.0:1787430769.812824:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189184 00000100:00100000:3.0:1787430769.812907:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 321 00000100:00100000:3.0:1787430769.812920:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:10769:x1874256836189184:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787430769.813074:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:10769:x1874256836189184:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.813080:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 321 00000100:00100000:1.0:1787430769.816147:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430769.816561:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189312 00000100:00100000:0.0:1787430769.816572:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189312 00000100:00100000:0.0:1787430769.816718:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 322 00000100:00100000:0.0:1787430769.816728:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:6162:x1874256836189312:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430769.816755:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430769.816774:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a94247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138843 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.816801:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a94247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138843 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.816810:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a94247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138843 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.816816:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d200, rc 0) 00000100:00100000:0.0:1787430769.816867:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836189312:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 141us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430769.816872:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 322 00000100:00100000:1.0:1787430769.818523:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430769.818637:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189440 00000100:00100000:3.0:1787430769.818644:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189440 00000100:00100000:3.0:1787430769.818716:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 323 00000100:00100000:3.0:1787430769.818724:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836189440:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430769.818857:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836189440:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.818865:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 323 00000100:00100000:3.0:1787430769.823466:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430769.824397:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189568 00000100:00100000:0.0:1787430769.824408:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189568 00000100:00100000:0.0:1787430769.824527:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 324 00000100:00100000:0.0:1787430769.824541:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836189568:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430769.824716:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:6162:x1874256836189568:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 177us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430769.824725:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 324 00000100:00100000:1.0:1787430769.829413:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430769.830390:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189696 00000100:00100000:3.0:1787430769.830402:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189696 00000100:00100000:3.0:1787430769.830460:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 325 00000100:00100000:3.0:1787430769.830471:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:10772:x1874256836189696:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787430769.830670:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:10772:x1874256836189696:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 200us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.830678:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 325 00000100:00100000:1.0:1787430769.833056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430769.833176:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189824 00000100:00100000:0.0:1787430769.833185:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189824 00000100:00100000:0.0:1787430769.833251:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 326 00000100:00100000:0.0:1787430769.833262:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:10772:x1874256836189824:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430769.833489:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:10772:x1874256836189824:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 228us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430769.833497:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 326 00000100:00100000:3.0:1787430769.920141:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430769.920189:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847784448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430769.920255:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430769.920347:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784448 00000100:00100000:3.0:1787430769.920354:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784448 00000100:00100000:3.0:1787430769.920400:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430769.920410:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847784448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430769.920443:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430769.920492:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847784448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.920499:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430769.920549:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847784448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430769.920687:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847784576:0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.920715:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921119:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847784320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430769.921152:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921188:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847784832:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921211:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921229:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847785344:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921250:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921265:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847785856:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921287:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921304:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787430769.921309:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847784704:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921330:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921346:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847785216:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921364:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921379:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847785728:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921396:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921431:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847784960:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921452:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921470:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847785472:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921489:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921506:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847785984:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921522:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921538:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430769.921543:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847786112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430769.921562:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.921589:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784832 00000100:00100000:2.0:1787430769.921593:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784832 00000100:00100000:2.0:1787430769.921658:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787430769.921666:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847784832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921706:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847784832:12345-0@lo:400:kworker.0 Request processed in 42us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.921714:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787430769.921755:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785344 00000100:00100000:2.0:1787430769.921759:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785344 00000100:00100000:2.0:1787430769.921791:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785856 00000100:00100000:2.0:1787430769.921795:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785856 00000100:00100000:2.0:1787430769.921808:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785472 00000100:00100000:2.0:1787430769.921810:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785472 00000100:00100000:2.0:1787430769.921822:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785984 00000100:00100000:2.0:1787430769.921825:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785984 00000100:00100000:2.0:1787430769.921838:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787430769.921845:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847785344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921875:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847785344:12345-0@lo:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.921891:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787430769.921903:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787430769.921909:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847785856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921936:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847785856:12345-0@lo:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.921942:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787430769.921953:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787430769.921958:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847785472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.921987:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847785472:12345-0@lo:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.921993:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787430769.922003:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787430769.922009:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847785984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.922048:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847785984:12345-0@lo:400:kworker.0 Request processed in 40us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.922055:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787430769.922076:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784704 00000100:00100000:2.0:1787430769.922080:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784704 00000100:00100000:3.0:1787430769.922141:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784320 00000100:00100000:3.0:1787430769.922145:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784320 00000100:00100000:3.0:1787430769.922168:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847786112 00000100:00100000:3.0:1787430769.922170:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847786112 00000100:00100000:3.0:1787430769.922182:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430769.922188:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847784320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430769.922205:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430769.922235:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847784320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.922241:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430769.922253:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430769.922259:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847786112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430769.922268:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430769.922298:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847786112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.922304:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787430769.922366:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430769.922370:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430769.925517:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847785088:0@lo:400:kworker.0 00000100:00100000:2.0:1787430769.925807:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785216 00000100:00100000:2.0:1787430769.925815:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785216 00000100:00100000:0.0:1787430769.925932:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430769.926687:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847785600:0@lo:400:kworker.0 00000100:00100000:0.0:1787430769.926721:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430769.926812:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785728 00000100:00100000:3.0:1787430769.926819:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785728 00000100:00100000:3.0:1787430769.926846:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784960 00000100:00100000:3.0:1787430769.926850:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784960 00000100:00100000:3.0:1787430769.926861:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785088 00000100:00100000:3.0:1787430769.926863:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785088 00000100:00100000:3.0:1787430769.926880:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787430769.926890:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847784704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.927061:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847784704:12345-0@lo:400:kworker.0 Request processed in 171us (5727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.927069:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787430769.927088:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787430769.927095:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847785216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.927137:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847785216:12345-0@lo:400:kworker.0 Request processed in 43us (5772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.927145:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787430769.927254:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787430769.927263:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847785728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.927295:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847785728:12345-0@lo:400:kworker.0 Request processed in 35us (5898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.927301:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787430769.927314:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787430769.927320:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847784960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.927349:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847784960:12345-0@lo:400:kworker.0 Request processed in 29us (5895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.927464:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787430769.927477:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787430769.927484:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847785088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.927514:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847785088:12345-0@lo:400:kworker.0 Request processed in 31us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.927519:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787430769.927639:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847784704:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927655:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd6a00 x1874256847785216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927666:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847785216:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927675:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034f8380 x1874256847785728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927683:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847785728:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927695:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03e55500 x1874256847784320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927709:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847784320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430769.927721:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847784832:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927732:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034f8000 x1874256847785344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927739:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847785344:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927763:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034f8e00 x1874256847785856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927778:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847785856:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927838:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03e55f80 x1874256847786112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927852:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847786112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430769.927863:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847784960:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927876:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034fb800 x1874256847785472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927884:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847785472:0@lo:400:kworker.0 00010000:00080000:3.0:1787430769.927894:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034faa00 x1874256847785984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430769.927903:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847785984:0@lo:400:kworker.0 00000100:00080000:3.0:1787430769.927947:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430769.927952:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787430769.927978:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847784576 00000100:00100000:3.0:1787430769.927984:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847784576 00000100:00100000:3.0:1787430769.928017:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787430769.928023:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3628:x1874256847784576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.928057:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3628:x1874256847784576:12345-0@lo:400:kworker.0 Request processed in 34us (7341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.928063:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787430769.928780:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847784576:0@lo:400:kworker.0 00000100:00100000:0.0:1787430769.928794:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847785088:0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.928862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847785600 00000100:00100000:3.0:1787430769.928867:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847785600 00000100:00100000:3.0:1787430769.928959:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787430769.928975:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847785600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430769.929015:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847785600:12345-0@lo:400:kworker.0 Request processed in 41us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.929023:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787430769.929139:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430769.929178:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847785600:0@lo:400:kworker.0 10000000:01000000:2.0:1787430769.983723:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787430769.983731:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c363a8000 from 7 10000000:01000000:2.0:1787430769.983737:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430769.983811:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430769.983824:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430769.983850:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430769.983875:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430769.983958:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.984133:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430769.984530:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847786240 00000100:00100000:0.0:1787430769.984538:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847786240 00000100:00100000:0.0:1787430769.984660:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787430769.984670:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:6494:x1874256847786240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430769.984684:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430769.984697:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1ce00/0x4dbb683ba6a94255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9424e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.984722:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1ce00/0x4dbb683ba6a94255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9424e expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.984732:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1ce00/0x4dbb683ba6a94255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9424e expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430769.984741:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1ce00, rc 0) 00000100:00100000:0.0:1787430769.984814:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847786240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430769.984821:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787430769.984982:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430769.985002:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430769.985011:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430769.985072:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430769.985099:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.985389:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430769.985533:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847786368 00000100:00100000:3.0:1787430769.985539:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847786368 00000100:00100000:2.0:1787430769.985687:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787430769.985700:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847786368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430769.985848:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847786368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.985855:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787430769.985983:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430769.986014:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430769.986059:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430769.986085:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a761900 going to sleep for 11 seconds 00000100:00100000:2.0:1787430769.986171:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847786496 00000100:00100000:2.0:1787430769.986175:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847786496 00000100:00100000:2.0:1787430769.986194:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787430769.986200:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847786496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430769.986295:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847786496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.986301:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787430769.986432:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430769.987114:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13765:1874256847786624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430769.987168:0:13765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430769.987199:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a761e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430769.987297:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847786624 00000100:00100000:2.0:1787430769.987302:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847786624 00000100:00100000:2.0:1787430769.987324:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787430769.987330:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:13765:x1874256847786624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430769.987418:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c199ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:13765:x1874256847786624:12345-0@lo:502:llog_process_th.0 Request processed in 88us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430769.987426:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787430769.987511:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13765:1874256847786624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430769.987532:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430769.987541:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430769.987543:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430769.987550:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c363a8000 00000020:00000080:3.0:1787430769.987679:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430769.987879:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430769.987885:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430769.987886:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430769.987889:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430769.987892:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430769.987894:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787430769.987897:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c363a8000 00000020:00000080:3.0:1787430769.987904:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787430769.989809:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13765:1874256847786752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430769.989877:0:13765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430769.989912:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a761e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430769.989945:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847786752 00000100:00100000:3.0:1787430769.989951:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847786752 00000100:00100000:3.0:1787430769.989988:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787430769.989997:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:13765:x1874256847786752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430769.990102:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:13765:x1874256847786752:12345-0@lo:502:llog_process_th.0 Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430769.990110:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787430769.990171:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13765:1874256847786752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430769.990194:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430769.990201:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430769.990203:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787430769.990206:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787430769.990343:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787430769.990363:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430769.990372:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430769.990383:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430769.990393:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430769.990395:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c35f42000 from 7 10000000:01000000:3.0:1787430769.990398:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430769.990419:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430769.990439:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430769.990449:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430769.990462:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430769.990489:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430769.990505:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a761e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430769.992976:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847786880 00000100:00100000:1.0:1787430769.992986:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847786880 00000100:00100000:1.0:1787430769.993038:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787430769.993049:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:6494:x1874256847786880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430769.993065:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430769.993082:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360eee00/0x4dbb683ba6a94263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9425c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430769.993108:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360eee00/0x4dbb683ba6a94263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9425c expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430769.993120:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360eee00/0x4dbb683ba6a94263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9425c expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430769.993129:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360eee00, rc 0) 00000100:00100000:1.0:1787430769.993193:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847786880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430769.993200:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787430769.993252:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847786880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430769.993270:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430769.993279:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430769.993358:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430769.993389:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430769.993415:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c09165cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430769.993428:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787008 00000100:00100000:1.0:1787430769.993432:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787008 00000100:00100000:1.0:1787430769.993451:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787430769.993457:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847787008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430769.993551:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847787008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430769.994869:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787430769.994920:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430769.994957:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430769.995006:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430769.995042:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430769.995057:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787136 00000100:00100000:1.0:1787430769.995062:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787136 00000100:00100000:1.0:1787430769.995087:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787430769.995096:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847787136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430769.995188:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847787136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430769.995195:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787430769.995232:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430769.995814:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13767:1874256847787264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430769.995850:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430769.995880:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430769.995994:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787264 00000100:00100000:0.0:1787430769.996000:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787264 00000100:00100000:0.0:1787430769.996034:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787430769.996041:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:13767:x1874256847787264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430769.996655:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:13767:x1874256847787264:12345-0@lo:502:llog_process_th.0 Request processed in 613us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430769.996664:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787430770.000488:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13767:1874256847787264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430770.000533:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430770.000543:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.000545:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430770.000550:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c35f42000 00000020:00000080:2.0:1787430770.000565:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787430770.000769:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430770.000773:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.000775:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430770.000778:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430770.000780:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.000781:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787430770.000784:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c35f42000 00000020:00000080:2.0:1787430770.000786:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430770.005521:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13767:1874256847787392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430770.005802:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430770.005848:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430770.005983:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787392 00000100:00100000:3.0:1787430770.005992:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787392 00000100:00100000:3.0:1787430770.006231:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787430770.006243:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:13767:x1874256847787392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430770.006380:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:13767:x1874256847787392:12345-0@lo:502:llog_process_th.0 Request processed in 139us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430770.006389:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787430770.006511:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13767:1874256847787392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430770.006538:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430770.006546:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.006548:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787430770.006552:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787430770.006829:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787430770.006860:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430770.006870:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.006881:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430770.006891:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430770.006894:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a2800 from 7 10000000:01000000:1.0:1787430770.006896:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430770.006920:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.006927:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.006936:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430770.006951:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430770.006982:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430770.007001:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430770.007057:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787520 00000100:00100000:3.0:1787430770.007063:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787520 00000100:00100000:3.0:1787430770.007101:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787430770.007109:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:6494:x1874256847787520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430770.007119:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430770.007133:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a94271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9426a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430770.007155:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a94271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9426a expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430770.007177:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a94271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9426a expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430770.007186:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491800, rc 0) 00000100:00100000:3.0:1787430770.007215:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847787520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430770.007222:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787430770.007301:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430770.007314:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.007322:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430770.007369:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430770.007401:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430770.007429:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430770.007477:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787648 00000100:00100000:3.0:1787430770.007482:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787648 00000100:00100000:3.0:1787430770.007512:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787430770.007519:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847787648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430770.007644:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847787648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430770.007652:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787430770.007788:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430770.007814:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430770.007850:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430770.007876:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430770.008777:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787776 00000100:00100000:3.0:1787430770.008784:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787776 00000100:00100000:3.0:1787430770.008825:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787430770.008833:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847787776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430770.008929:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847787776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430770.008936:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787430770.008981:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847787776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787430770.011162:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787430770.018205:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13770:1874256847787904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430770.018308:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430770.018358:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430770.018405:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847787904 00000100:00100000:1.0:1787430770.018413:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847787904 00000100:00100000:1.0:1787430770.018467:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787430770.018478:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:13770:x1874256847787904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430770.018886:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:13770:x1874256847787904:12345-0@lo:502:llog_process_th.0 Request processed in 408us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430770.018894:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787430770.020088:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13770:1874256847787904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430770.020124:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430770.020135:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.020137:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430770.020145:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c3a6a2800 00000020:00000080:2.0:1787430770.020149:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787430770.020216:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430770.020221:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.020222:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430770.020225:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430770.020228:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.020229:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787430770.020233:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c3a6a2800 00000020:00000080:2.0:1787430770.020235:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430770.020276:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13770:1874256847788032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430770.020328:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430770.020359:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430770.022494:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788032 00000100:00100000:1.0:1787430770.022506:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788032 00000100:00100000:1.0:1787430770.022559:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787430770.022569:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:13770:x1874256847788032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430770.022741:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:13770:x1874256847788032:12345-0@lo:502:llog_process_th.0 Request processed in 172us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430770.022762:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787430770.023077:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13770:1874256847788032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430770.023107:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430770.023115:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.023116:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787430770.023121:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787430770.023678:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787430770.023698:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430770.023708:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.023720:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430770.023737:0:6494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430770.023740:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c04f2d000 from 7 10000000:01000000:1.0:1787430770.023752:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430770.023782:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.023789:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.023798:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430770.023816:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847788160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430770.023857:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430770.023896:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430770.023910:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788160 00000100:00100000:0.0:1787430770.023917:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788160 00000100:00100000:0.0:1787430770.023960:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787430770.023969:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:6494:x1874256847788160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430770.023980:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430770.023992:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a9427f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a94278 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430770.024013:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a9427f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a94278 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430770.024025:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a9427f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a94278 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430770.024034:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1cc00, rc 0) 00000100:00100000:0.0:1787430770.024076:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847788160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430770.024093:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787430770.024469:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847788160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430770.024479:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430770.024485:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430770.024525:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847788288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430770.024544:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430770.024562:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430770.024623:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788288 00000100:00100000:2.0:1787430770.024628:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788288 00000100:00100000:2.0:1787430770.024660:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787430770.024665:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847788288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430770.024770:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847788288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430770.024775:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787430770.024868:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847788288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430770.024901:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847788416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430770.024943:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430770.024975:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c86240 going to sleep for 11 seconds 00000100:00100000:2.0:1787430770.025038:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788416 00000100:00100000:2.0:1787430770.025042:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788416 00000100:00100000:2.0:1787430770.025076:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787430770.025083:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847788416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430770.025156:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:6494:x1874256847788416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430770.025163:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787430770.025201:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:6494:1874256847788416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430770.025364:0:13772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13772:1874256847788544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430770.025409:0:13772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430770.025426:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788544 00000100:00100000:2.0:1787430770.025430:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788544 00000100:00100000:2.0:1787430770.025447:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787430770.025453:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:13772:x1874256847788544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430770.025519:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:13772:x1874256847788544:12345-0@lo:502:llog_process_th.0 Request processed in 66us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430770.025526:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787430770.025553:0:13772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430770.025565:0:13772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13772:1874256847788544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430770.025582:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430770.025591:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.025593:0:13772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430770.025622:0:13772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c04f2d000 00000020:00000080:2.0:1787430770.025625:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787430770.025675:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430770.025679:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.025680:0:13772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430770.025682:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430770.025685:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.025686:0:13772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787430770.025690:0:13772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c04f2d000 00000020:00000080:2.0:1787430770.025691:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430770.025722:0:13772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13772:1874256847788672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430770.025765:0:13772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430770.025782:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788672 00000100:00100000:2.0:1787430770.025785:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788672 00000100:00100000:2.0:1787430770.025799:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787430770.025804:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:13772:x1874256847788672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430770.025861:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:13772:x1874256847788672:12345-0@lo:502:llog_process_th.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430770.025868:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787430770.025900:0:13772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430770.025912:0:13772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:13772:1874256847788672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430770.025928:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430770.025932:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430770.025934:0:13772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787430770.025937:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787430770.026109:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787430770.026134:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430770.026142:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430770.026152:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430770.032117:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787430770.688001:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787430771.073099:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787430771.073631:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:1.0:1787430771.458037:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787430771.458126:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1787430771.458159:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787430771.459452:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847788800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787430771.459527:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430771.459676:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788800 00000100:00100000:2.0:1787430771.459684:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788800 00000100:00100000:2.0:1787430771.459760:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787430771.459776:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847788800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787430771.459804:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1787430771.459839:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8a076d, atime: 0x6a8a076d, ctime: 0x6a8a076d, blocks: 0x0 00010000:00010000:2.0:1787430771.459853:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430771.459870:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1787430771.459874:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430771.459881:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430771.459916:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430771.459927:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430771.459936:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787430771.460026:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787430771.460057:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430771.460082:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460093:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460101:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460108:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1dc00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430771.460112:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460120:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460135:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff8e2b03b33e00) 00010000:00010000:0.0:1787430771.460139:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430771.460145:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430771.460243:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847788800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 474us (714us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787430771.460251:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1787430771.460477:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b03cf1180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787430771.460484:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847788800:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787430771.460563:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430771.460570:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430771.460584:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430771.460588:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430771.460597:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430771.460673:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430771.460681:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94286 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430771.460699:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430771.460701:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430771.460703:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430771.460790:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a9418a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460815:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460821:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460826:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460830:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c013eb000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430771.460833:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460838:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460847:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:0.0:1787430771.460849:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430771.460852:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460857:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c013eb000/0x4dbb683ba6a9419f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460873:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460878:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460883:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460892:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430771.460895:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460901:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460908:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff8e2b03b33e00) 00010000:00010000:0.0:1787430771.460911:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430771.460986:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.460994:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94208 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.461012:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.461018:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.461023:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.461028:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1de00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430771.461031:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.461036:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.461117:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2b03b33000) 00010000:00010000:0.0:1787430771.461119:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430771.461123:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430771.461128:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94224 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430771.711773:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430772.479831:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847788928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430772.479941:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430772.479946:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430772.479963:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847789056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430772.480006:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430772.480064:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789056 00000100:00100000:1.0:1787430772.480064:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847788928 00000100:00100000:3.0:1787430772.480072:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789056 00000100:00100000:1.0:1787430772.480073:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847788928 00000100:00100000:1.0:1787430772.480127:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787430772.480137:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847788928:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430772.480161:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787430772.480170:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847789056:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1787430772.480182:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430772.480230:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847788928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430772.480237:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787430772.480257:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430772.480284:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847788928:0@lo:13:osp-pre-0-1.0 00000004:00000024:3.0:1787430772.480336:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787430772.480382:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847789056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 213us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430772.480400:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787430772.480516:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847789056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430772.480628:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430772.480640:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847789184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430772.480668:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430772.481810:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789184 00000100:00100000:1.0:1787430772.481819:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789184 00000100:00100000:1.0:1787430772.481859:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787430772.481867:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847789184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430772.481894:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430772.481946:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847789184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430772.481964:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787430772.482015:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847789184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787430772.735863:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430773.759579:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430773.761835:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430773.761870:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430773.761891:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430773.761915:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430773.761966:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430773.762000:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190336 00000100:00100000:1.0:1787430773.762010:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190336 00000100:00100000:1.0:1787430773.762072:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:1.0:1787430773.762084:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836190336:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430773.762154:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836190336:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430773.762162:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00080000:1.0:1787430773.762273:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430773.762361:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190208 00000100:00100000:0.0:1787430773.762366:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190208 00000100:00100000:0.0:1787430773.762409:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190464 00000100:00100000:0.0:1787430773.762412:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190464 00000100:00100000:0.0:1787430773.762426:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190080 00000100:00100000:0.0:1787430773.762429:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190080 00000100:00100000:0.0:1787430773.762444:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190592 00000100:00100000:0.0:1787430773.762446:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190592 00000100:00100000:0.0:1787430773.762462:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:0.0:1787430773.762469:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836190208:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430773.762506:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836190208:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 37us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430773.762513:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:0.0:1787430773.762527:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:0.0:1787430773.762533:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836190464:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430773.762557:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836190464:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430773.762574:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:0.0:1787430773.762588:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:0.0:1787430773.762594:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836190080:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430773.762640:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836190080:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 46us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430773.762646:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:0.0:1787430773.762659:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:0.0:1787430773.762666:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836190592:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430773.762689:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836190592:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430773.762695:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00080000:1.0:1787430773.763028:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430773.763032:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430773.763583:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836189952 00000100:00100000:2.0:1787430773.763590:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836189952 00000100:00100000:2.0:1787430773.763744:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 348 00000100:00100000:2.0:1787430773.763754:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836189952:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430773.763799:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836189952:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 47us (4241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430773.763805:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 348 00010000:00010000:2.0:1787430773.768221:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430774.783847:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430775.039843:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847789312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430775.039909:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430775.039965:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430775.039969:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847789440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430775.039982:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430775.040004:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789312 00000100:00100000:3.0:1787430775.040010:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789312 00000100:00100000:3.0:1787430775.040047:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789440 00000100:00100000:3.0:1787430775.040049:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789440 00000100:00100000:3.0:1787430775.040061:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430775.040067:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847789312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430775.040095:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430775.040147:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847789312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430775.040153:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430775.040165:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787430775.040169:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847789440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430775.040177:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430775.040192:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847789440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 23us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430775.040195:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787430775.040205:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787430775.040226:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03e54700 x1874256847789440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430775.040253:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847789440:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787430775.040261:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034f8000 x1874256847789312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430775.040268:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847789312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430775.040631:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430775.040643:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847789568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430775.040672:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430775.040862:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847789952:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.040905:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847789824:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.040938:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430775.040958:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847790336:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.040979:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430775.041001:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847790848:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.041022:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430775.041055:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789824 00000100:00100000:2.0:1787430775.041059:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789824 00000100:00100000:2.0:1787430775.041081:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790336 00000100:00100000:2.0:1787430775.041084:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790336 00000100:00100000:2.0:1787430775.041107:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790848 00000100:00100000:2.0:1787430775.041109:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790848 00000100:00100000:2.0:1787430775.041139:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787430775.041145:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847789824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.041182:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847789824:12345-0@lo:400:kworker.0 Request processed in 37us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430775.041190:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787430775.041204:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787430775.041210:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847790336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.041237:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847790336:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430775.041243:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787430775.041254:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787430775.041260:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847790848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.041285:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847790848:12345-0@lo:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430775.041291:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1787430775.041316:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430775.041335:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847789824:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.041343:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847790336:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.041351:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847790848:0@lo:400:kworker.0 00000100:00100000:0.0:1787430775.041480:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847789696:0@lo:400:kworker.0 00000100:00100000:0.0:1787430775.041511:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430775.041531:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847790208:0@lo:400:kworker.0 00000100:00100000:0.0:1787430775.041570:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430775.041573:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789696 00000100:00100000:1.0:1787430775.041577:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789696 00000100:00100000:1.0:1787430775.041635:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787430775.041643:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847789696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430775.041677:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847789696:12345-0@lo:400:kworker.0 Request processed in 36us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430775.041684:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787430775.041726:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847790080:0@lo:400:kworker.0 00000100:00100000:1.0:1787430775.041757:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430775.041775:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847790592:0@lo:400:kworker.0 00000100:00100000:1.0:1787430775.041797:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430775.041823:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790080 00000100:00100000:1.0:1787430775.041827:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790080 00000100:00100000:1.0:1787430775.041847:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787430775.041862:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847790080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430775.041886:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847790080:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430775.041889:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787430775.041907:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847790080:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.042025:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790592 00000100:00100000:2.0:1787430775.042028:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790592 00000100:00100000:2.0:1787430775.042060:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787430775.042064:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847790592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.042091:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847790592:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430775.042097:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787430775.042461:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430775.042481:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847790592:0@lo:400:kworker.0 00000100:00100000:1.0:1787430775.047913:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430775.047916:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847790720:0@lo:400:kworker.0 00000100:00100000:0.0:1787430775.047982:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430775.048032:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847789696:0@lo:400:kworker.0 00000100:00100000:0.0:1787430775.048083:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790720 00000100:00100000:0.0:1787430775.048089:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790720 00000100:00100000:0.0:1787430775.048165:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787430775.048174:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847790720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430775.048232:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847790720:12345-0@lo:400:kworker.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430775.048239:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787430775.048262:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430775.048283:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847790720:0@lo:400:kworker.0 00000100:00100000:3.0:1787430775.051489:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789568 00000100:00100000:3.0:1787430775.051505:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789568 00000100:00100000:2.0:1787430775.051577:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790208 00000100:00100000:2.0:1787430775.051583:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790208 00000100:00100000:3.0:1787430775.051653:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787430775.051665:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847789568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430775.051719:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430775.051803:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847789568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (11131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430775.051811:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787430775.051829:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787430775.051835:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847790208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430775.051863:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847790208:12345-0@lo:400:kworker.0 Request processed in 29us (10295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430775.051869:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787430775.069227:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847789952 00000100:00100000:2.0:1787430775.069243:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847789952 00000100:00100000:1.0:1787430775.069276:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847790464:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.069317:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787430775.069327:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847789952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430775.069337:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430775.069367:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847790976:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.069381:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847789952:12345-0@lo:400:kworker.0 Request processed in 55us (21476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430775.069389:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787430775.069453:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790464 00000100:00100000:0.0:1787430775.069457:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790464 00000100:00100000:2.0:1787430775.069463:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847790208:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.069479:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847789568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430775.069491:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787430775.069499:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847790464:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787430775.069588:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430775.072503:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430775.072562:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847790976 00000100:00100000:2.0:1787430775.072571:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847790976 00000100:00100000:2.0:1787430775.072649:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787430775.072673:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847790976:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787430775.075877:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430775.080291:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847789952:0@lo:400:kworker.0 00000100:00100000:1.0:1787430775.080418:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847790464:12345-0@lo:400:kworker.0 Request processed in 10918us (11076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430775.080430:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:3.0:1787430775.081137:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c35d65180 x1874256847790464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430775.081148:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847790464:0@lo:400:kworker.0 00000100:00100000:2.0:1787430775.082310:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847790976:12345-0@lo:400:kworker.0 Request processed in 9636us (9809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430775.082321:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00080000:3.0:1787430775.082488:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c35d64700 x1874256847790976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430775.082520:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847790976:0@lo:400:kworker.0 00010000:00010000:2.0:1787430775.807814:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430776.834257:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430777.599818:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430777.599829:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847791360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430777.599914:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430777.599914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430777.599979:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847791104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430777.599986:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847791360 00000100:00100000:2.0:1787430777.599994:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847791360 00000100:00100000:3.0:1787430777.600011:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847791232 00000100:00100000:1.0:1787430777.600016:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430777.600018:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847791232 00000100:00100000:2.0:1787430777.600059:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847791104 00000100:00100000:2.0:1787430777.600064:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847791104 00000100:00100000:3.0:1787430777.600065:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787430777.600069:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787430777.600080:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847791232:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430777.600083:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847791360:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430777.600091:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787430777.600094:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430777.600102:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847791104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430777.600118:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787430777.600118:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787430777.600120:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787430777.600187:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847791104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430777.600194:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787430777.600300:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847791232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 224us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430777.600307:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847791360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430777.600311:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787430777.600321:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787430777.600354:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430777.600368:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847791360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430777.600380:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847791104:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1787430777.601359:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1787430777.855804:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430778.880993:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430778.882008:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430778.882073:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430778.882110:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430778.882156:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430778.882177:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430778.882201:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430778.882245:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190848 00000100:00100000:1.0:1787430778.882262:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190848 00000100:00100000:2.0:1787430778.882371:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836191104 00000100:00100000:2.0:1787430778.882377:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836191104 00000100:00100000:0.0:1787430778.882522:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836191360 00000100:00100000:0.0:1787430778.882527:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836191360 00000100:00100000:3.0:1787430778.882577:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190976 00000100:00100000:3.0:1787430778.882581:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190976 00000100:00080000:1.0:1787430778.889430:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430778.889442:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430778.889447:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430778.889530:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836191232 00000100:00100000:1.0:1787430778.889546:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836191232 00000100:00080000:1.0:1787430778.889579:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430778.889589:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:2.0:1787430778.889627:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836191104:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430778.889631:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:1.0:1787430778.889645:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836190848:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430778.889737:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836191104:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 136us (7662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430778.889744:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836190848:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 101us (7748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430778.889752:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:1.0:1787430778.889785:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:2.0:1787430778.889787:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836190720 00000100:00100000:2.0:1787430778.889792:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836190720 00000100:00100000:1.0:1787430778.889812:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:1.0:1787430778.889827:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836191232:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430778.889832:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 350 00000100:00100000:2.0:1787430778.889844:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836190720:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430778.889865:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836191232:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 45us (7662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430778.889872:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:2.0:1787430778.889888:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836190720:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 45us (7728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430778.889896:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 350 00000100:00100000:0.0:1787430778.890232:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:0.0:1787430778.890243:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836191360:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430778.890286:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836191360:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 45us (8174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430778.890293:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:3.0:1787430778.891090:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:3.0:1787430778.891100:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836190976:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430778.891150:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836190976:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 51us (8971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430778.891157:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 145 00010000:00010000:2.0:1787430779.904036:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430780.163719:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847791488:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.163805:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.163859:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847792000:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.163887:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.163906:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847792512:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.163928:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.163956:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847793024:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.163978:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.164004:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787430780.164009:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847791616:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.164034:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.164049:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847792128:0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164249:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847791488 00000100:00100000:1.0:1787430780.164256:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847791488 00000100:00100000:1.0:1787430780.164303:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787430780.164313:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847791488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164361:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847791488:12345-0@lo:400:kworker.0 Request processed in 50us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.164369:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787430780.164400:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847791616 00000100:00100000:1.0:1787430780.164404:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847791616 00000100:00100000:1.0:1787430780.164428:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787430780.164434:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847791616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164465:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847791616:12345-0@lo:400:kworker.0 Request processed in 31us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.164471:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787430780.164508:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792512 00000100:00100000:1.0:1787430780.164512:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792512 00000100:00100000:1.0:1787430780.164540:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793024 00000100:00100000:1.0:1787430780.164544:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793024 00000100:00100000:1.0:1787430780.164564:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787430780.164571:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847792512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164641:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847792512:12345-0@lo:400:kworker.0 Request processed in 70us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.164647:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787430780.164671:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787430780.164677:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847793024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164706:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847793024:12345-0@lo:400:kworker.0 Request processed in 30us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.164713:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787430780.164733:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792000 00000100:00100000:1.0:1787430780.164738:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792000 00000100:00100000:0.0:1787430780.164764:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847791744:0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164768:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787430780.164779:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847792000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430780.164810:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430780.164820:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847792000:12345-0@lo:400:kworker.0 Request processed in 41us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.164826:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430780.164838:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847792256:0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164839:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847791744 00000100:00100000:1.0:1787430780.164844:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847791744 00000100:00100000:1.0:1787430780.164865:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787430780.164873:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847791744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430780.164877:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847791872:0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.164915:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847791744:12345-0@lo:400:kworker.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.164923:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787430780.164934:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430780.164939:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430780.165349:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430780.169739:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847793152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430780.169843:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430780.179043:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430780.180560:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793152 00000100:00100000:1.0:1787430780.180582:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793152 00000100:00100000:1.0:1787430780.180792:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430780.180805:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847793152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787430780.180873:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787430780.182893:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847792640:0@lo:400:kworker.0 00000100:00100000:3.0:1787430780.182974:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.183164:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430780.183168:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847792384:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.183213:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847791488:0@lo:400:kworker.0 00000100:00100000:3.0:1787430780.183215:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.183234:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847792000:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.183250:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787430780.183255:0:3629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b03cf1180, transno 4294967301 00000100:00100000:3.0:1787430780.183258:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847792896:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.183277:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847792512:0@lo:400:kworker.0 00000100:00100000:3.0:1787430780.183294:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787430780.183299:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c35d65180 x1874256847793024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430780.183311:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847793024:0@lo:400:kworker.0 00000100:00100000:3.0:1787430780.183329:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847793408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430780.183347:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847791616:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.183371:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792128 00000100:00100000:3.0:1787430780.183376:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430780.183377:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792128 00000100:00100000:2.0:1787430780.183431:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792256 00000100:00100000:2.0:1787430780.183435:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792256 00000100:00100000:2.0:1787430780.183451:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847791872 00000100:00100000:2.0:1787430780.183454:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847791872 00000100:00100000:2.0:1787430780.183466:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792640 00000100:00100000:2.0:1787430780.183469:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792640 00000100:00100000:2.0:1787430780.183487:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787430780.183496:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847792128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.183544:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847792128:12345-0@lo:400:kworker.0 Request processed in 48us (19473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430780.183551:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787430780.183566:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787430780.183573:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847792256:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787430780.183702:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430780.183706:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430780.183730:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787430780.183738:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847791872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.184822:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847792256:12345-0@lo:400:kworker.0 Request processed in 1247us (7887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430780.184831:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787430780.184851:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787430780.184860:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847792640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.184896:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847792640:12345-0@lo:400:kworker.0 Request processed in 39us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430780.184907:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847791872:12345-0@lo:400:kworker.0 Request processed in 1134us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430780.184912:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787430780.184947:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787430780.185020:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847792128:0@lo:400:kworker.0 00000100:00100000:3.0:1787430780.185040:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847791872:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.185048:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847792640:0@lo:400:kworker.0 00000100:00100000:3.0:1787430780.185110:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792384 00000100:00100000:3.0:1787430780.185115:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792384 00000100:00100000:2.0:1787430780.185137:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792896 00000100:00100000:2.0:1787430780.185143:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792896 00000100:00100000:3.0:1787430780.185173:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787430780.185221:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847792384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.185235:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787430780.185246:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847792896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430780.185500:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793408 00000100:00100000:0.0:1787430780.185505:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793408 00000100:00100000:0.0:1787430780.185535:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787430780.185542:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847793408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430780.185562:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430780.185668:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847792384:12345-0@lo:400:kworker.0 Request processed in 470us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430780.185690:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787430780.185738:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430780.185753:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430780.187375:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847793152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6569us (17528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.187386:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430780.187455:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847793152:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1787430780.187524:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c35d65f80 x1874256847792256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430780.187536:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847792256:0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.187546:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847792768:0@lo:400:kworker.0 00000100:00100000:1.0:1787430780.187584:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430780.187921:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847793280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430780.188436:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430780.188470:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793280 00000100:00100000:1.0:1787430780.188477:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793280 00000100:00100000:1.0:1787430780.188512:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787430780.188521:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1874256847793280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787430780.188547:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430780.188585:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1874256847793280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430780.188592:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1787430780.188752:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3f901880 x1874256847793280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430780.188820:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847793280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430780.188854:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847791744:0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.189987:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847792896:12345-0@lo:400:kworker.0 Request processed in 4735us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430780.189998:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787430780.190250:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847792768 00000100:00100000:2.0:1787430780.190259:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847792768 00000100:00100000:2.0:1787430780.190419:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787430780.190430:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847792768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430780.190494:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847792768:12345-0@lo:400:kworker.0 Request processed in 67us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430780.190501:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00080000:2.0:1787430780.190547:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c35d67100 x1874256847792768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430780.190560:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847792768:0@lo:400:kworker.0 00000100:00080000:1.0:1787430780.193709:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787430780.194213:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034f8000 x1874256847793408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430780.194251:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847793408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430780.194326:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847792384:0@lo:400:kworker.0 00010000:00080000:3.0:1787430780.194363:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c35d64700 x1874256847792896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430780.194384:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847792896:0@lo:400:kworker.0 00000100:00100000:0.0:1787430780.194389:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847793408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8835us (11001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430780.194404:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1787430780.932754:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430781.312371:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787430781.313245:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787430781.954271:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430782.720311:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430782.720333:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847793536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430782.720410:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430782.720492:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793536 00000100:00100000:2.0:1787430782.720500:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793536 00000100:00100000:2.0:1787430782.720553:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787430782.720564:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847793536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430782.720593:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430782.720669:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847793536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430782.720677:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787430782.720929:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430782.720975:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847793536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430782.721211:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430782.721228:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847793664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430782.721271:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430782.721568:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793664 00000100:00100000:3.0:1787430782.721579:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793664 00000100:00100000:3.0:1787430782.721666:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787430782.721675:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847793664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430782.721715:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787430782.721764:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847793664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430782.721778:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787430782.721878:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847793664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430782.722233:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847793792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430782.722294:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430782.722375:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793792 00000100:00100000:0.0:1787430782.722386:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793792 00000100:00100000:0.0:1787430782.722460:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787430782.722468:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847793792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787430782.722488:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787430782.722660:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430782.722794:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847793792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 326us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430782.722802:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787430782.722907:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847793792:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787430782.975887:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430783.998132:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430783.998700:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836191488 00000100:00100000:1.0:1787430783.998712:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836191488 00000100:00100000:1.0:1787430783.998781:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 352 00000100:00100000:1.0:1787430783.998793:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836191488:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430783.998875:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836191488:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 85us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430783.998884:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 352 00010000:00010000:2.0:1787430783.999709:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430784.231417:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430784.231650:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836191744 00000100:00100000:3.0:1787430784.231662:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836191744 00000100:00100000:1.0:1787430784.231762:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430784.231806:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430784.231831:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430784.231856:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430784.231933:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836191872 00000100:00100000:3.0:1787430784.231937:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836191872 00000100:00100000:3.0:1787430784.232000:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:3.0:1787430784.232020:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836191872:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430784.232267:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192000 00000100:00100000:0.0:1787430784.232273:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192000 00000100:00100000:2.0:1787430784.232294:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836191616 00000100:00100000:0.0:1787430784.232300:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192128 00000100:00100000:2.0:1787430784.232301:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836191616 00000100:00100000:0.0:1787430784.232318:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192128 00000100:00100000:2.0:1787430784.232330:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 152 00000100:00100000:2.0:1787430784.232340:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836191744:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430784.232347:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00100000:0.0:1787430784.232358:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836192000:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430784.232404:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836191872:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 394us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430784.232412:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00080000:3.0:1787430784.232437:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430784.232441:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430784.232450:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430784.232579:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 154 00000100:00100000:1.0:1787430784.232721:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1787430784.232731:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:3.0:1787430784.232948:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836191616:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430784.232988:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836191616:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 402us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430784.232996:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 154 00000100:00100000:3.0:1787430784.233025:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:3.0:1787430784.233033:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836192128:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430784.233059:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836192128:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430784.233065:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:0.0:1787430784.234326:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836192000:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1963us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430784.234337:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00100000:2.0:1787430784.234587:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836191744:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 2247us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430784.234595:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 152 00010000:00010000:1.0:1787430785.023857:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430785.280090:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847794048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430785.280166:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430785.280231:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794048 00000100:00100000:2.0:1787430785.280241:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794048 00000100:00100000:2.0:1787430785.280302:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787430785.280315:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847794048:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430785.280350:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847794560:0@lo:400:kworker.0 00000004:00000024:2.0:1787430785.280359:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787430785.280380:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430785.280399:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847795072:0@lo:400:kworker.0 00000100:00100000:2.0:1787430785.280423:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847794048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430785.280430:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430785.280435:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787430785.280451:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847795584:0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.280470:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430785.280477:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847794176:0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.280507:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847794048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430785.280517:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430785.280552:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795072 00000100:00100000:2.0:1787430785.280554:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847794688:0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.280557:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795072 00000100:00100000:2.0:1787430785.280580:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430785.280641:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795584 00000100:00100000:3.0:1787430785.280644:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847793920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430785.280645:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795584 00000100:00100000:1.0:1787430785.280674:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787430785.280682:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847795072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.280690:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430785.280722:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847794432:0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.280733:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847795072:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430785.280741:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787430785.280751:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430785.280758:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787430785.280767:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847795584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.280774:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847794944:0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.280802:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847795584:12345-0@lo:400:kworker.0 Request processed in 36us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430785.280808:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787430785.280835:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847795072:0@lo:400:kworker.0 00010000:00080000:1.0:1787430785.280847:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e14e00 x1874256847795584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430785.280857:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847795584:0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.280875:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847794304:0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.280898:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430785.280907:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430785.280924:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847795456:0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.280930:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847794816:0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.280963:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430785.280964:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430785.280990:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847795328:0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.281006:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794560 00000100:00100000:1.0:1787430785.281009:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430785.281012:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794560 00000100:00100000:1.0:1787430785.281045:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794688 00000100:00100000:3.0:1787430785.281048:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794304 00000100:00100000:1.0:1787430785.281049:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794688 00000100:00100000:3.0:1787430785.281054:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794304 00000100:00100000:1.0:1787430785.281074:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794816 00000100:00100000:1.0:1787430785.281077:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794816 00000100:00100000:1.0:1787430785.281088:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795328 00000100:00100000:1.0:1787430785.281090:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795328 00000100:00100000:1.0:1787430785.281102:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787430785.281189:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787430785.281226:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847795200:0@lo:400:kworker.0 00000100:00100000:0.0:1787430785.281243:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794944 00000100:00100000:0.0:1787430785.281248:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794944 00000100:00100000:2.0:1787430785.281254:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430785.281274:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847795712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430785.281275:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795456 00000100:00100000:0.0:1787430785.281279:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795456 00000100:00100000:0.0:1787430785.281299:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787430785.281304:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430785.281310:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847794944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430785.281354:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847794944:12345-0@lo:400:kworker.0 Request processed in 48us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430785.281356:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795200 00000100:00100000:2.0:1787430785.281362:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795200 00000100:00100000:0.0:1787430785.281363:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787430785.281384:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787430785.281390:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847795456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430785.281417:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847795456:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430785.281422:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787430785.281440:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787430785.281450:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847794816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430785.281477:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847794816:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430785.281486:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787430785.281499:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787430785.281510:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847795328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430785.281536:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847795328:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430785.281545:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787430785.281555:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787430785.285461:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787430785.285480:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847795200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.285480:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847794560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.285554:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847794688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.285735:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847794688:12345-0@lo:400:kworker.0 Request processed in 4538us (5154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430785.285744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1787430785.285787:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430785.285792:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430785.285807:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430785.285810:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430785.285832:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794432 00000100:00100000:3.0:1787430785.285843:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794432 00000100:00100000:3.0:1787430785.285877:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787430785.285885:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847794432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.285920:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847794432:12345-0@lo:400:kworker.0 Request processed in 37us (5171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430785.285926:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787430785.286013:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847794432:0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.286028:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847794944:0@lo:400:kworker.0 00010000:00080000:3.0:1787430785.286045:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e17100 x1874256847795456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430785.286056:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847795456:0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.286144:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847794688:0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.286343:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847793920 00000100:00100000:3.0:1787430785.286348:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847793920 00000100:00100000:3.0:1787430785.286379:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795712 00000100:00100000:3.0:1787430785.286382:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795712 00000100:00100000:3.0:1787430785.286395:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430785.286402:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847793920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430785.286434:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430785.286478:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847793920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (5792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430785.286485:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430785.286497:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787430785.286503:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847795712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430785.286512:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430785.286536:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847795712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430785.286542:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787430785.286564:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd6680 x1874256847793920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430785.286582:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847793920:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787430785.286650:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a639880 x1874256847795712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430785.286665:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847795712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430785.286710:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847794176 00000100:00100000:3.0:1787430785.286714:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847794176 00000100:00100000:3.0:1787430785.286750:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787430785.286758:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847794176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430785.286764:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847794560:12345-0@lo:400:kworker.0 Request processed in 4603us (5332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430785.286776:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787430785.286801:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847794176:12345-0@lo:400:kworker.0 Request processed in 43us (6285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430785.286809:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787430785.286828:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847794560:0@lo:400:kworker.0 00000100:00100000:3.0:1787430785.286862:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847794176:0@lo:400:kworker.0 00010000:00080000:1.0:1787430785.287475:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e14a80 x1874256847795328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430785.287484:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847795328:0@lo:400:kworker.0 00010000:00080000:1.0:1787430785.287498:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e15500 x1874256847794816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430785.287504:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847794816:0@lo:400:kworker.0 00000100:00100000:0.0:1787430785.291184:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847794304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430785.291304:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847794304:12345-0@lo:400:kworker.0 Request processed in 9741us (10396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430785.291315:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787430785.291675:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847794304:0@lo:400:kworker.0 00000100:00100000:2.0:1787430785.331945:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847795200:12345-0@lo:400:kworker.0 Request processed in 46462us (50680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430785.331961:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787430785.332083:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847795200:0@lo:400:kworker.0 00010000:00010000:2.0:1787430786.052707:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430787.073562:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430787.840377:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847795968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430787.840452:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430787.840472:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847795840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430787.840515:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430787.840621:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795968 00000100:00100000:1.0:1787430787.840630:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795968 00000100:00100000:0.0:1787430787.840739:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847795840 00000100:00100000:0.0:1787430787.840744:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847795840 00000100:00100000:3.0:1787430787.841720:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847796096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430787.841753:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430787.841790:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796096 00000100:00100000:3.0:1787430787.841794:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796096 00000100:00100000:3.0:1787430787.841834:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787430787.841841:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847796096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430787.841875:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787430787.841912:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847796096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430787.841919:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787430787.841959:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847796096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430787.906835:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787430787.906854:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847795968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430787.906887:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430787.906990:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847795968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (66539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430787.907010:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787430787.909786:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847795968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430787.915344:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787430787.915361:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847795840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430787.915388:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430787.915489:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847795840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (74974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430787.915497:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787430787.915567:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847795840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787430787.916024:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787430788.095852:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430789.118500:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430789.118563:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430789.118625:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430789.118654:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192512 00000100:00100000:3.0:1787430789.118664:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192512 00000100:00100000:3.0:1787430789.118720:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192384 00000100:00100000:3.0:1787430789.118724:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192384 00000100:00100000:3.0:1787430789.118748:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:3.0:1787430789.118759:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836192512:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430789.118828:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836192512:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430789.118848:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:3.0:1787430789.118869:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:3.0:1787430789.118876:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836192384:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430789.118901:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836192384:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430789.118908:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00080000:3.0:1787430789.118927:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430789.118932:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430789.119130:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192256 00000100:00100000:0.0:1787430789.119135:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192256 00000100:00100000:0.0:1787430789.119166:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 354 00000100:00100000:0.0:1787430789.119173:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836192256:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430789.119201:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836192256:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430789.119214:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 354 00010000:00010000:0.0:1787430789.121917:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430789.143776:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430789.143861:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192640 00000100:00100000:3.0:1787430789.143871:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192640 00000100:00100000:3.0:1787430789.143942:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:3.0:1787430789.143953:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2398:x1874256836192640:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:3.0:1787430789.143980:0:8830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a941ad 00000100:00080000:3.0:1787430789.144000:0:8830:0:(import.c:65:import_set_state_nolock()) ffff8e2b03e90800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787430789.144043:0:8830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1787430789.144190:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+2:2398:x1874256836192640:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 238us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430789.144197:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00010000:00010000:3.0:1787430789.144223:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430789.144455:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430789.144793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430789.144828:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430789.144848:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192768 00000100:00100000:3.0:1787430789.144853:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192768 00000100:00100000:3.0:1787430789.144885:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836192896 00000100:00100000:3.0:1787430789.144888:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836192896 00000100:00100000:3.0:1787430789.144911:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:3.0:1787430789.144931:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836192768:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430789.144965:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836192768:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 36us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430789.144972:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:3.0:1787430789.144999:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:3.0:1787430789.145007:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836192896:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430789.145030:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836192896:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430789.145037:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00080000:1.0:1787430789.145151:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430789.145154:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430790.146734:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430790.404730:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847796352:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.404796:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430790.404843:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847796864:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.404863:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430790.404894:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847797376:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.404915:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430790.404942:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787430790.404947:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847796480:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.404966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430790.404986:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847796992:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405004:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430790.405016:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847797504:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405034:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430790.405062:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796352 00000100:00100000:2.0:1787430790.405068:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796352 00000100:00100000:2.0:1787430790.405110:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796864 00000100:00100000:2.0:1787430790.405113:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796864 00000100:00100000:2.0:1787430790.405134:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847797376 00000100:00100000:2.0:1787430790.405137:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847797376 00000100:00100000:2.0:1787430790.405150:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796992 00000100:00100000:2.0:1787430790.405152:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796992 00000100:00100000:2.0:1787430790.405166:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847797504 00000100:00100000:2.0:1787430790.405168:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847797504 00000100:00100000:2.0:1787430790.405183:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787430790.405191:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847796352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405236:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847796352:12345-0@lo:400:kworker.0 Request processed in 46us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.405242:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787430790.405256:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787430790.405261:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847796864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405281:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847796864:12345-0@lo:400:kworker.0 Request processed in 21us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.405293:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787430790.405304:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787430790.405308:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847797376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405328:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847797376:12345-0@lo:400:kworker.0 Request processed in 20us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.405332:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787430790.405342:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787430790.405347:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847796992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405367:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847796992:12345-0@lo:400:kworker.0 Request processed in 20us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.405372:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787430790.405382:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787430790.405387:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847797504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405406:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847797504:12345-0@lo:400:kworker.0 Request processed in 20us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.405411:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1787430790.405426:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430790.405430:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787430790.405450:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03de4000 x1874256847796992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430790.405464:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847796992:0@lo:400:kworker.0 00010000:00080000:2.0:1787430790.405472:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03579880 x1874256847797504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430790.405478:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847797504:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405493:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847796352:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405500:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847796864:0@lo:400:kworker.0 00000100:00100000:2.0:1787430790.405507:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847797376:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.405822:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847796608:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.405848:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.405865:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847797120:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.405886:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.405901:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847797632:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.405919:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.405937:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787430790.405942:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847796224:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.405966:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.406000:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847796736:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406021:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.406037:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847797248:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406056:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.406070:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847797760:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406095:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.406117:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796608 00000100:00100000:3.0:1787430790.406121:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796608 00000100:00100000:3.0:1787430790.406146:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787430790.406153:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847796608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406183:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847796608:12345-0@lo:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406188:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787430790.406209:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796480 00000100:00100000:3.0:1787430790.406213:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796480 00000100:00100000:3.0:1787430790.406232:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796736 00000100:00100000:3.0:1787430790.406235:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796736 00000100:00100000:3.0:1787430790.406247:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787430790.406254:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847796480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406283:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847796480:12345-0@lo:400:kworker.0 Request processed in 29us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406288:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787430790.406299:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787430790.406304:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847796736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406324:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847796736:12345-0@lo:400:kworker.0 Request processed in 20us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406329:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787430790.406365:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847797120 00000100:00100000:3.0:1787430790.406368:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847797120 00000100:00100000:3.0:1787430790.406391:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847797632 00000100:00100000:3.0:1787430790.406394:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847797632 00000100:00100000:3.0:1787430790.406402:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847797248 00000100:00100000:3.0:1787430790.406404:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847797248 00000100:00100000:3.0:1787430790.406421:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847797760 00000100:00100000:3.0:1787430790.406423:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847797760 00000100:00100000:3.0:1787430790.406433:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787430790.406439:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847797120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406463:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847797120:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406468:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787430790.406478:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787430790.406483:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847797632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406503:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847797632:12345-0@lo:400:kworker.0 Request processed in 19us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406508:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787430790.406516:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787430790.406521:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847797248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406573:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847797248:12345-0@lo:400:kworker.0 Request processed in 52us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406579:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787430790.406592:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787430790.406597:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847797760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406636:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847797760:12345-0@lo:400:kworker.0 Request processed in 39us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406642:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787430790.406661:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847796224 00000100:00100000:3.0:1787430790.406663:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847796224 00000100:00100000:3.0:1787430790.406685:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787430790.406690:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847796224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.406721:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847796224:12345-0@lo:400:kworker.0 Request processed in 31us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406727:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787430790.406766:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847798016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430790.406794:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.406813:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430790.406818:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847797888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430790.406835:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430790.406854:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798016 00000100:00100000:3.0:1787430790.406857:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798016 00000100:00100000:3.0:1787430790.406876:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787430790.406882:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847798016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430790.406900:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430790.406927:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847798016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.406933:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1787430790.406961:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b034f8000 x1874256847798016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430790.406977:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847798016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430790.407004:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847797888 00000100:00100000:3.0:1787430790.407007:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847797888 00000100:00100000:3.0:1787430790.407024:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787430790.407029:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847797888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430790.407046:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430790.407075:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847797888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.407085:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787430790.407110:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847797888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430790.407126:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847796224:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.407133:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847796736:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.407142:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847797248:0@lo:400:kworker.0 00010000:00080000:3.0:1787430790.407150:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03578e00 x1874256847797760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430790.407158:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847797760:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.407166:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847796608:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.407173:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847797120:0@lo:400:kworker.0 00010000:00080000:3.0:1787430790.407181:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b0357bb80 x1874256847797632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430790.407189:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847797632:0@lo:400:kworker.0 00000100:00100000:3.0:1787430790.407224:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847796480:0@lo:400:kworker.0 00000100:00080000:2.0:1787430790.407508:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430790.407512:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430790.407519:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847798144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430790.407763:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430790.407791:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798144 00000100:00100000:2.0:1787430790.407795:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798144 00000100:00100000:2.0:1787430790.407819:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787430790.407826:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847798144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787430790.407837:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430790.407865:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847798144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.407871:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787430790.407895:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b0357bb80 x1874256847798144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430790.407907:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847798144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787430791.177180:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430791.556575:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787430791.589441:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787430792.192768:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430792.959876:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847798272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430792.959945:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430792.960211:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798272 00000100:00100000:1.0:1787430792.960219:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798272 00000100:00100000:3.0:1787430792.960315:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847798400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430792.960363:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430792.960394:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430792.960413:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847798528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430792.960437:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430792.960478:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798528 00000100:00100000:3.0:1787430792.960482:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798528 00000100:00100000:0.0:1787430792.960591:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798400 00000100:00100000:0.0:1787430792.960596:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798400 00000100:00100000:1.0:1787430792.960639:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787430792.960650:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847798272:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430792.960654:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787430792.960660:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847798400:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1787430792.960678:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1787430792.960679:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787430792.960723:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847798272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430792.960723:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847798400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430792.960731:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430792.960731:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787430792.960772:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847798272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430792.960772:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847798400:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787430792.960919:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430792.961079:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787430792.961086:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847798528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430792.961095:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430792.961131:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847798528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430792.961137:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430792.961590:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847798528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787430793.215903:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430794.238582:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430794.238662:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430794.238704:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430794.238739:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430794.238765:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430794.238794:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193152 00000100:00100000:3.0:1787430794.238805:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193152 00000100:00100000:3.0:1787430794.238860:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193408 00000100:00100000:3.0:1787430794.238864:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193408 00000100:00100000:3.0:1787430794.238883:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193280 00000100:00100000:3.0:1787430794.238886:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193280 00000100:00100000:3.0:1787430794.238899:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193536 00000100:00100000:3.0:1787430794.238902:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193536 00000100:00100000:3.0:1787430794.238918:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00100000:3.0:1787430794.238928:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836193152:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430794.239028:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836193152:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 89us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430794.239055:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00100000:3.0:1787430794.239076:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 173 00000100:00100000:3.0:1787430794.239083:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836193408:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430794.239110:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836193408:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430794.239116:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 173 00000100:00100000:3.0:1787430794.239129:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 174 00000100:00100000:3.0:1787430794.239135:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836193280:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430794.239158:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836193280:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430794.239164:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 174 00000100:00100000:3.0:1787430794.239177:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:3.0:1787430794.239183:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836193536:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430794.239205:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836193536:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430794.239212:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:2.0:1787430794.239649:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193024 00000100:00100000:2.0:1787430794.239655:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193024 00000100:00100000:2.0:1787430794.239690:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 356 00000100:00100000:2.0:1787430794.239698:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836193024:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430794.239740:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836193024:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 43us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430794.239748:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 356 00010000:00010000:2.0:1787430794.239809:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430794.239874:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430794.239879:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787430794.497028:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:3.0:1787430794.497038:0:8404:0:(genops.c:885:class_export_put()) final put ffff8e2b03e91000/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:2.0:1787430794.497120:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03e91000/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-OST0000 00000020:00000080:2.0:1787430794.497176:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03e90800 for lustre-OST0000 00010000:00010000:2.0:1787430795.263778:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430795.519870:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847798656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430795.519983:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430795.521027:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430795.521037:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847798912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430795.521067:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430795.521099:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798912 00000100:00100000:2.0:1787430795.521105:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798912 00000100:00100000:2.0:1787430795.521142:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787430795.521150:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847798912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787430795.521181:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787430795.521216:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847798912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.521223:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787430795.521258:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847798912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430795.521271:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787430795.521276:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847798784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430795.521294:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430795.521314:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798656 00000100:00100000:2.0:1787430795.521323:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798656 00000100:00100000:2.0:1787430795.521348:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847798784 00000100:00100000:2.0:1787430795.521350:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847798784 00000100:00100000:2.0:1787430795.521362:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787430795.521366:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847798656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787430795.521383:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430795.521410:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847798656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.521416:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787430795.521426:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787430795.521430:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847798784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430795.521437:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430795.521453:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847798784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 23us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.521458:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787430795.521469:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787430795.521486:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e14a80 x1874256847798784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430795.521499:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847798784:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787430795.521507:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b0357bb80 x1874256847798656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430795.521531:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847798656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430795.523129:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847799424:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523167:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523187:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847799936:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523205:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523220:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787430795.523224:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847799040:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523242:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523260:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847799552:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523274:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523285:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847800064:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523307:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523328:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799424 00000100:00100000:0.0:1787430795.523333:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799424 00000100:00100000:0.0:1787430795.523361:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799552 00000100:00100000:0.0:1787430795.523363:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799552 00000100:00100000:0.0:1787430795.523387:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800064 00000100:00100000:0.0:1787430795.523389:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800064 00000100:00100000:0.0:1787430795.523405:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787430795.523411:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847799424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523444:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847799424:12345-0@lo:400:kworker.0 Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.523450:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787430795.523462:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787430795.523467:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847799552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523485:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847799552:12345-0@lo:400:kworker.0 Request processed in 19us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.523490:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787430795.523498:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787430795.523502:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847800064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523537:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847800064:12345-0@lo:400:kworker.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.523542:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787430795.523556:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799936 00000100:00100000:0.0:1787430795.523559:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799936 00000100:00100000:0.0:1787430795.523579:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430795.523584:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847799936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523626:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847799936:12345-0@lo:400:kworker.0 Request processed in 42us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.523637:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430795.523653:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799040 00000100:00100000:0.0:1787430795.523656:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799040 00000100:00100000:0.0:1787430795.523686:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787430795.523692:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847799040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523715:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847799040:12345-0@lo:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.523720:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787430795.523758:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847799040:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523767:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847799552:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523773:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847800064:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523780:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847799424:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523786:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847799936:0@lo:400:kworker.0 00000100:00080000:0.0:1787430795.523810:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430795.523814:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430795.523822:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847799168:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523842:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523859:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847799680:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523878:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523892:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847800192:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.523909:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.523924:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787430795.524023:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847799296:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524050:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.524064:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847799808:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524077:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.524095:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799168 00000100:00100000:0.0:1787430795.524097:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799168 00000100:00100000:0.0:1787430795.524113:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799680 00000100:00100000:0.0:1787430795.524115:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799680 00000100:00100000:0.0:1787430795.524127:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800192 00000100:00100000:0.0:1787430795.524129:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800192 00000100:00100000:0.0:1787430795.524138:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787430795.524143:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847799168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524166:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847799168:12345-0@lo:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.524171:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787430795.524180:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787430795.524185:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847799680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524201:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847799680:12345-0@lo:400:kworker.0 Request processed in 17us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.524206:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787430795.524213:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787430795.524218:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847800192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524234:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847800192:12345-0@lo:400:kworker.0 Request processed in 16us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.524238:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787430795.524253:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799296 00000100:00100000:0.0:1787430795.524256:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799296 00000100:00100000:0.0:1787430795.524274:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787430795.524285:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847799296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524311:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847799296:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.524316:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787430795.524329:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847799808 00000100:00100000:0.0:1787430795.524331:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847799808 00000100:00100000:0.0:1787430795.524349:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430795.524353:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847799808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524374:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847799808:12345-0@lo:400:kworker.0 Request processed in 21us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.524379:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787430795.524394:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430795.524396:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430795.524411:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847799296:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524418:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847799808:0@lo:400:kworker.0 00000100:00100000:0.0:1787430795.524424:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847799168:0@lo:400:kworker.0 00010000:00080000:0.0:1787430795.524433:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d19180 x1874256847799680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430795.524442:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847799680:0@lo:400:kworker.0 00010000:00080000:0.0:1787430795.524449:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03490700 x1874256847800192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430795.524456:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847800192:0@lo:400:kworker.0 00000001:02000400:0.0:1787430795.777184:0:14032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:33:14 (1787430794) 00010000:00010000:0.0:1787430796.292379:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430797.311966:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430798.079826:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787430798.079850:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847800448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430798.079918:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430798.080011:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847800320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430798.080039:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430798.080207:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800448 00000100:00100000:3.0:1787430798.080215:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800448 00000100:00100000:3.0:1787430798.080343:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787430798.080355:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847800448:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787430798.080484:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787430798.080572:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430798.080823:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847800448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 470us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430798.080830:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787430798.083871:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847800448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430798.100736:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800320 00000100:00100000:1.0:1787430798.100751:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800320 00000100:00100000:1.0:1787430798.100818:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787430798.100828:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847800320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787430798.100864:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787430798.100957:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847800320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (20915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.100965:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787430798.101446:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430798.101590:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847800320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430798.102443:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847800576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430798.102623:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430798.109810:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800576 00000100:00100000:0.0:1787430798.109825:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800576 00000100:00100000:0.0:1787430798.109946:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787430798.109957:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847800576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787430798.109982:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430798.110058:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847800576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (7436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430798.110065:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787430798.110444:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847800576:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787430798.112774:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430798.188129:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430798.188327:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193664 00000100:00100000:0.0:1787430798.188337:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193664 00000100:00100000:0.0:1787430798.188428:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:0.0:1787430798.188456:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:11062:x1874256836193664:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430798.188643:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430798.188721:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9428d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913884a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.188788:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94294 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.188819:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.188833:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430798.188881:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430798.188886:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430798.189330:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.189357:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9428d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913884a expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.189377:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913884a expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.189387:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33b00) 00010000:00010000:0.0:1787430798.189390:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430798.189393:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1c000, rc 0) 00000100:00100000:0.0:1787430798.189647:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:11062:x1874256836193664:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1195us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430798.189656:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00080000:2.0:1787430798.189754:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430798.196709:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430798.196812:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193792 00000100:00100000:0.0:1787430798.196823:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193792 00000100:00100000:0.0:1787430798.196894:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:0.0:1787430798.196906:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:11063:x1874256836193792:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430798.196925:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430798.196954:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9429b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138851 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197140:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197157:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197169:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197183:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197191:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197198:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197260:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a942b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197269:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a942b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197276:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a942b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430798.197313:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430798.197317:0:8819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430798.197336:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a942b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197353:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197360:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197367:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197372:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430798.197376:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197383:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197396:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33b00) 00010000:00010000:0.0:1787430798.197398:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430798.197403:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197408:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197420:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197427:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197504:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197516:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1de00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430798.197520:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197526:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197534:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e2b03b33100) 00010000:00010000:0.0:1787430798.197537:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430798.197539:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197545:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197575:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9429b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138851 expref: 8 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197586:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a942b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138851 expref: 7 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.197594:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2b03b33e00) 00010000:00010000:0.0:1787430798.197596:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430798.197599:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1dc00, rc 0) 00000100:00100000:0.0:1787430798.197749:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11063:x1874256836193792:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 844us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430798.197757:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:3.0:1787430798.204878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430798.205039:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836193920 00000100:00100000:0.0:1787430798.205061:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836193920 00000100:00100000:0.0:1787430798.205138:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1787430798.205149:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11063:x1874256836193920:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787430798.205238:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11063:x1874256836193920:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 Request processed in 91us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430798.205246:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1787430798.212327:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430798.212398:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836194176 00000100:00100000:0.0:1787430798.212409:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836194176 00000100:00100000:0.0:1787430798.212474:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:0.0:1787430798.212495:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11063:x1874256836194176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430798.212516:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430798.212538:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a942b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138858 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212644:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212659:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212671:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212728:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212736:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212743:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212857:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a942cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212866:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a942cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212874:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a942cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430798.212884:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787430798.212961:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212969:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212976:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212983:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1de00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430798.212987:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.212994:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213006:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2b03b33e00) 00010000:00010000:0.0:1787430798.213009:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430798.213013:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213029:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a942be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213043:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213050:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213056:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213061:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430798.213077:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213084:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213092:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e2b03b33100) 00010000:00010000:0.0:1787430798.213094:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430798.213097:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213104:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a942c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213358:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a942b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138858 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213371:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a942cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138858 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430798.213384:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:0.0:1787430798.213387:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430798.213389:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d400, rc 0) 00000100:00100000:0.0:1787430798.213455:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:11063:x1874256836194176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 972us (1136us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787430798.213463:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:1.0:1787430798.221227:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430798.221545:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836194304 00000100:00100000:0.0:1787430798.221556:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836194304 00000100:00100000:1.0:1787430798.221659:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:1.0:1787430798.221670:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:11063:x1874256836194304:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787430798.221787:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:11063:x1874256836194304:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 118us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.221794:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:3.0:1787430798.226421:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430798.226547:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836194432 00000100:00100000:2.0:1787430798.226556:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836194432 00000100:00100000:2.0:1787430798.226658:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:2.0:1787430798.226669:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:11063:x1874256836194432:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787430798.230704:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787430798.231181:0:6496:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4473us 00000100:00100000:1.0:1787430798.242454:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:11063:x1874256836194432:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 15779us (16034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.242476:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00010000:00010000:2.0:1787430798.335898:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430798.784352:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787430798.785429:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787430799.360821:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430799.360871:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430799.360922:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430799.360951:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430799.360990:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430799.361015:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836194688 00000100:00100000:3.0:1787430799.361025:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836194688 00000100:00100000:3.0:1787430799.361082:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836194944 00000100:00100000:3.0:1787430799.361085:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836194944 00000100:00100000:3.0:1787430799.361112:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836194816 00000100:00100000:3.0:1787430799.361115:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836194816 00000100:00100000:3.0:1787430799.361135:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836195072 00000100:00100000:3.0:1787430799.361138:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836195072 00000100:00100000:3.0:1787430799.361160:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:3.0:1787430799.361169:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2402:x1874256836194688:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430799.361246:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2402:x1874256836194688:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 77us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430799.361260:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:3.0:1787430799.361312:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:3.0:1787430799.361319:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836194944:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430799.361364:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836194944:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430799.361371:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:3.0:1787430799.361383:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:3.0:1787430799.361389:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836194816:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430799.361433:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836194816:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 43us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430799.361440:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:3.0:1787430799.361451:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:3.0:1787430799.361458:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836195072:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430799.361491:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836195072:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430799.361498:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00080000:3.0:1787430799.361519:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430799.361523:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430799.362488:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836194560 00000100:00100000:2.0:1787430799.362496:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836194560 00000100:00100000:2.0:1787430799.362554:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 358 00000100:00100000:2.0:1787430799.362563:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836194560:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430799.366075:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836194560:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 3501us (5140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430799.366089:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 358 00010000:00010000:2.0:1787430799.366176:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430800.383876:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430800.423787:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430800.424807:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836195200 00000100:00100000:2.0:1787430800.424819:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836195200 00000100:00100000:2.0:1787430800.424915:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:2.0:1787430800.424927:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:11105:x1874256836195200:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430800.424946:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430800.424967:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a942da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913885f expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425034:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425049:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425079:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425095:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425109:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425116:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425163:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425170:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.425176:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787430800.426136:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787430800.426556:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430800.426562:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.426570:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.426597:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33b00) 00010000:00010000:2.0:1787430800.427728:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430800.427736:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427751:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a942e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427765:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427772:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427779:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427784:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430800.427787:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427795:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427807:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e2c11493200) 00010000:00010000:2.0:1787430800.427809:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430800.427813:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427818:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a942e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427862:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a942da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913885f expref: 10 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427936:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33b00) 00010000:00010000:2.0:1787430800.427940:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430800.427945:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a942da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913885f expref: 10 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.427955:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02200, rc 0) 00000100:00100000:2.0:1787430800.428027:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:11105:x1874256836195200:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 3101us (4247us total) trans 0 rc 301/301 00000100:00100000:2.0:1787430800.428036:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:1.0:1787430800.436700:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430800.436994:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836195456 00000100:00100000:3.0:1787430800.437005:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836195456 00000100:00100000:3.0:1787430800.437070:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:3.0:1787430800.437082:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:11105:x1874256836195456:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:3.0:1787430800.437140:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430800.437168:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94294 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913884a expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.437209:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b33b00) 00010000:00010000:3.0:1787430800.437295:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430800.437483:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.437496:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.437506:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.437520:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.437527:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.437534:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.439108:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.439128:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.439139:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430800.439157:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca2a48e4 reply state 0000000045dfd931 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.439183:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.439191:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430800.439194:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430800.439198:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787430800.439204:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787430800.439213:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.439220:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.440039:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.440045:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430800.440049:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.440057:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.440069:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:3.0:1787430800.440071:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430800.440074:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.440080:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a942ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430800.440115:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca2a48e4 reply state 0000000045dfd931 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.440126:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.440133:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e2c1847b600) 00010000:00010000:3.0:1787430800.440135:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430800.440138:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787430800.440303:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:11105:x1874256836195456:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 3219us (3608us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787430800.440311:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:1.0:1787430800.642104:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430800.642127:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847800704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430800.642195:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.642258:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847800832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430800.642284:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.642321:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800704 00000100:00100000:1.0:1787430800.642329:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800704 00000100:00100000:1.0:1787430800.644095:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787430800.644136:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847800704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787430800.644175:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787430800.644240:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847800704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.644257:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787430800.644288:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800832 00000100:00100000:1.0:1787430800.644295:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800832 00000100:00100000:1.0:1787430800.645232:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787430800.645244:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847800832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430800.645269:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430800.645310:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847800832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.645316:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787430800.645341:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847800960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430800.645384:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.645423:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847801472:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.645446:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.645472:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847801984:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.645494:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.645517:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787430800.645523:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847801344:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.645546:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.645563:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847801856:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.645628:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.645655:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847802368:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.645673:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787430800.645729:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e14000 x1874256847800832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430800.645760:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847800832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430800.645784:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847801088:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.645811:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.645830:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847801600:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.645847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.645860:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847802112:0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.647984:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847801216:0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.648063:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430800.648093:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847801728:0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.648128:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430800.648147:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847802240:0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.648169:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430800.648243:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801472 00000100:00100000:3.0:1787430800.648250:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801472 00000100:00100000:3.0:1787430800.648289:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801600 00000100:00100000:3.0:1787430800.648293:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801600 00000100:00100000:1.0:1787430800.648945:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847800960 00000100:00100000:1.0:1787430800.648952:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847800960 00000100:00100000:2.0:1787430800.650126:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801216 00000100:00100000:2.0:1787430800.650135:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801216 00000100:00100000:2.0:1787430800.650171:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801728 00000100:00100000:2.0:1787430800.650174:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801728 00000100:00080000:0.0:1787430800.650227:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430800.650231:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430800.650234:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430800.650319:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847802240 00000100:00100000:3.0:1787430800.650322:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847802240 00000100:00100000:3.0:1787430800.650342:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787430800.650351:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847801472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.650447:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847801472:12345-0@lo:400:kworker.0 Request processed in 96us (4999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430800.650476:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787430800.650497:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787430800.650503:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847801216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.650542:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847801216:12345-0@lo:400:kworker.0 Request processed in 39us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430800.650548:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787430800.650562:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787430800.650568:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847801600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.650641:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847801600:12345-0@lo:400:kworker.0 Request processed in 73us (4792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430800.650646:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787430800.650659:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787430800.650665:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847802240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.650710:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847802240:12345-0@lo:400:kworker.0 Request processed in 45us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430800.650717:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787430800.650769:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847801472:0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.650806:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847801216:0@lo:400:kworker.0 00010000:00080000:3.0:1787430800.650821:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b18380 x1874256847802240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430800.650832:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847802240:0@lo:400:kworker.0 00000100:00080000:0.0:1787430800.651117:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430800.651315:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787430800.651324:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847800960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787430800.651341:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430800.651703:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847800960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 378us (6316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.651710:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787430800.651742:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801984 00000100:00100000:1.0:1787430800.651748:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801984 00000100:00100000:1.0:1787430800.651782:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801856 00000100:00100000:1.0:1787430800.651785:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801856 00000100:00100000:1.0:1787430800.651803:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847802368 00000100:00100000:1.0:1787430800.651806:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847802368 00000100:00100000:1.0:1787430800.651821:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787430800.651828:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847801984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.651862:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847801984:12345-0@lo:400:kworker.0 Request processed in 34us (6366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.651868:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787430800.652026:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430800.652033:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847801856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.652065:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847801856:12345-0@lo:400:kworker.0 Request processed in 33us (6437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.652072:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430800.652082:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787430800.652088:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847802368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.652115:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847802368:12345-0@lo:400:kworker.0 Request processed in 27us (6440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.652120:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787430800.652142:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801344 00000100:00100000:1.0:1787430800.652146:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801344 00000100:00100000:1.0:1787430800.652172:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430800.652178:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847801344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.652208:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847801344:12345-0@lo:400:kworker.0 Request processed in 30us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.652214:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430800.652238:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847801088 00000100:00100000:1.0:1787430800.652242:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847801088 00000100:00100000:1.0:1787430800.652267:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787430800.652273:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.652303:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847801088:12345-0@lo:400:kworker.0 Request processed in 30us (6491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.652308:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787430800.652480:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430800.652525:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847800704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430800.652560:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847801088:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.652573:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847801600:0@lo:400:kworker.0 00000100:00080000:3.0:1787430800.653084:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430800.653097:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847802112 00000100:00100000:3.0:1787430800.653110:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847802112 00000100:00100000:3.0:1787430800.653154:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787430800.653161:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847802112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430800.653206:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847802112:12345-0@lo:400:kworker.0 Request processed in 45us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430800.653212:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1787430800.653228:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430800.653249:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847802112:0@lo:400:kworker.0 00000100:00100000:2.0:1787430800.654477:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787430800.654490:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847801728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430800.654553:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847801728:12345-0@lo:400:kworker.0 Request processed in 67us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430800.654561:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00080000:2.0:1787430800.654634:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1bb80 x1874256847801728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430800.654647:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847801728:0@lo:400:kworker.0 00000100:00100000:2.0:1787430800.661947:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430800.662085:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836195584 00000100:00100000:3.0:1787430800.662097:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836195584 00000100:00100000:3.0:1787430800.662158:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:3.0:1787430800.662170:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:11113:x1874256836195584:12345-192.168.202.25@tcp:101:lctl.0 00010000:00010000:3.0:1787430800.662195:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430800.662229:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138866 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.662302:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a9430b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.662316:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a9430b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.662329:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a9430b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430800.662393:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787430800.662398:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430800.662434:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a9430b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.662486:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138866 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.662504:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a9430b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138866 expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.662512:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:3.0:1787430800.662515:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430800.662518:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a400, rc 0) 00000100:00100000:3.0:1787430800.662588:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:11113:x1874256836195584:12345-192.168.202.25@tcp:101:lctl.0 Request processed in 408us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430800.662596:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00010000:00080000:0.0:1787430800.663196:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d19180 x1874256847800960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430800.663219:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847800960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430800.663842:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847801984:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.665038:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847801344:0@lo:400:kworker.0 00000100:00100000:1.0:1787430800.665238:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847801856:0@lo:400:kworker.0 00010000:00080000:1.0:1787430800.665253:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3a4dc700 x1874256847802368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430800.665264:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847802368:0@lo:400:kworker.0 00000100:00100000:0.0:1787430800.761906:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430800.762049:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836195712 00000100:00100000:3.0:1787430800.762061:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836195712 00000100:00100000:3.0:1787430800.762490:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1787430800.762503:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:11119:x1874256836195712:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1787430800.762524:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430800.762562:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913886d expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762686:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762702:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762713:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762742:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762750:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762757:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762879:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a94327 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762889:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a94327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762895:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a94327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430800.762931:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787430800.762935:0:8819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430800.762975:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a94327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762989:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.762996:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763003:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763023:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430800.763027:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763034:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763046:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:3.0:1787430800.763049:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430800.763053:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763059:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763071:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763076:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763081:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763086:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430800.763088:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763093:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763109:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e2c1847b600) 00010000:00010000:3.0:1787430800.763112:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430800.763115:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763121:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a94320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763146:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913886d expref: 13 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763159:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a94327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913886d expref: 12 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430800.763166:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430800.763168:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787430800.763171:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b600, rc 0) 00000100:00100000:3.0:1787430800.763244:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:11119:x1874256836195712:12345-192.168.202.25@tcp:101:bash.0 Request processed in 743us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430800.763251:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1787430800.769360:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430800.769554:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836195968 00000100:00100000:2.0:1787430800.769564:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836195968 00000100:00100000:2.0:1787430800.769677:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:2.0:1787430800.769702:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:11119:x1874256836195968:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430800.769724:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430800.769746:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9432e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138874 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.769855:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.769886:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.769898:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.769953:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.769961:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.769967:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430800.770454:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787430800.770846:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771339:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771356:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771412:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771419:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771426:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771431:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430800.771436:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771509:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771524:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430800.771527:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430800.771532:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771537:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94335 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430800.771552:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002365d712 reply state 0000000025a0ab79 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771563:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771568:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2c11493200) 00010000:00010000:2.0:1787430800.771577:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787430800.771581:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787430800.771936:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9432e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771952:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.771959:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:2.0:1787430800.771961:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430800.771963:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02400, rc 0) 00000100:00100000:2.0:1787430800.772053:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:11119:x1874256836195968:12345-192.168.202.25@tcp:101:bash.0 Request processed in 2353us (2702us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787430800.772061:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:2.0:1787430800.787651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430800.788114:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836196096 00000100:00100000:1.0:1787430800.788125:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836196096 00000100:00100000:1.0:1787430800.788169:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1787430800.788177:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874256836196096:12345-192.168.202.25@tcp:8:bash.0 00010000:00080000:1.0:1787430800.788213:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1787430800.788245:0:8408:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a94351 00002000:00100000:1.0:1787430800.788258:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 419b0c27-15f9-4e73-995a-bc02788ae1b0/ffff8e2c0782e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787430800.788270:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787430800.788345:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787430800.788389:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8e2c0782d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430800.788474:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836196096:12345-192.168.202.25@tcp:8:bash.0 Request processed in 295us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.788482:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:0.0:1787430800.792896:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430800.793067:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836196224 00000100:00100000:1.0:1787430800.793091:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836196224 00000100:00100000:1.0:1787430800.793175:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:1.0:1787430800.793186:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836196224:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1787430800.793204:0:11754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430800.793228:0:11754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913887b expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430800.793254:0:11754:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430800.793272:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=262s v=(0 0) 00010000:00010000:1.0:1787430800.793276:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430800.793286:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 7 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.793307:0:11754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 7 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.793320:0:11754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360eea00, rc 0) 00000100:00100000:1.0:1787430800.793399:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:0:x1874256836196224:12345-192.168.202.25@tcp:101:bash.0 Request processed in 214us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.793406:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00080000:3.0:1787430800.794023:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430800.805172:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430800.805442:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836196352 00000100:00100000:1.0:1787430800.805452:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836196352 00000100:00100000:1.0:1787430800.805573:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1787430800.806292:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11119:x1874256836196352:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1787430800.806317:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430800.806341:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138882 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.806497:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 8 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.806507:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430800.806511:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430800.806517:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.806557:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 8 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.806589:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 8 pid: 11754 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430800.806629:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847802496:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430800.806841:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430800.817368:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847802496:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430800.817415:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.817441:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ee400, rc 0) 00000100:00100000:1.0:1787430800.817520:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:11119:x1874256836196352:12345-192.168.202.25@tcp:101:bash.0 Request processed in 11924us (12358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430800.817529:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:0.0:1787430800.822261:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430800.822724:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836196480 00000100:00100000:2.0:1787430800.822740:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836196480 00010000:00010000:2.0:1787430800.822796:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 8 pid: 11754 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430800.822847:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:2.0:1787430800.823220:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11443850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836196480:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430800.823239:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430800.823262:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 8 pid: 11754 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.823277:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 8 pid: 11754 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.823314:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94358 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913887b expref: 8 pid: 11754 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.823341:0:10313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430800.823352:0:10313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430800.823361:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.823372:0:10313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430800.823442:0:10313:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430800.823482:0:10313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10313:1874256847802624:192.168.202.25@tcp:105: 00000100:00100000:2.0:1787430800.824428:0:10313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10e610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430800.837235:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430800.837351:0:10313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10313:1874256847802624:192.168.202.25@tcp:105: 00010000:00010000:2.0:1787430800.837388:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430800.837456:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11443850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836196480:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 14568us (15202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430800.837476:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:1.0:1787430800.838322:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836196736 00000100:00100000:1.0:1787430800.838333:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836196736 00000100:00100000:1.0:1787430800.838414:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1787430800.838427:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:11119:x1874256836196736:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:1.0:1787430800.839037:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11119:x1874256836196736:12345-192.168.202.25@tcp:35:bash.0 Request processed in 611us (1809us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787430800.839046:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:3.0:1787430800.955369:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430800.958756:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836196992 00000100:00100000:1.0:1787430800.958772:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836196992 00000100:00100000:1.0:1787430800.958859:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:1.0:1787430800.958870:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11129:x1874256836196992:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430800.958896:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430800.958920:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138889 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430800.959020:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787430800.959132:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94366 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138889 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.959147:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:1.0:1787430800.959150:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430800.959155:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138889 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430800.959169:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef000, rc 0) 00000100:00100000:1.0:1787430800.959244:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:11129:x1874256836196992:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 376us (3883us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1787430800.959268:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:2.0:1787430800.970291:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430800.970483:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836197248 00000100:00100000:1.0:1787430800.970494:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836197248 00000100:00100000:1.0:1787430800.970569:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1787430800.970581:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:11129:x1874256836197248:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1787430800.970870:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:11129:x1874256836197248:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 290us (588us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787430800.970878:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1787430801.144979:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430801.145145:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836197376 00000100:00100000:3.0:1787430801.145215:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836197376 00000100:00100000:3.0:1787430801.145281:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:3.0:1787430801.145308:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:11135:x1874256836197376:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430801.145335:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430801.145356:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138890 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.145424:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9437b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.145439:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9437b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.146714:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9437b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430801.146772:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787430801.146776:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430801.146796:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9437b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.146831:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138890 expref: 20 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.146851:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9437b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138890 expref: 19 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.146860:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430801.146863:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430801.146866:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:3.0:1787430801.147109:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:11135:x1874256836197376:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1803us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430801.147175:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:3.0:1787430801.162925:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430801.163170:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836197632 00000100:00100000:0.0:1787430801.163180:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836197632 00000100:00100000:0.0:1787430801.163246:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:0.0:1787430801.163258:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:11135:x1874256836197632:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430801.163297:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430801.163318:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94382 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138897 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.163428:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94389 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.163442:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.163587:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430801.163644:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787430801.163798:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94382 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138897 expref: 22 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.163817:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94389 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138897 expref: 21 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.163825:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:0.0:1787430801.163828:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430801.163832:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d600, rc 0) 00000100:00100000:0.0:1787430801.165089:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:11135:x1874256836197632:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1825us (2165us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787430801.165099:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:2.0:1787430801.178061:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430801.178787:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430801.178885:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836198016 00000100:00100000:0.0:1787430801.178896:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836198016 00000100:00100000:0.0:1787430801.178967:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:0.0:1787430801.178992:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:2401:x1874256836198016:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430801.179010:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430801.179035:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a94389 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138897 expref: 21 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.179056:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:0.0:1787430801.179062:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430801.179125:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:2401:x1874256836198016:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 135us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430801.179134:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:1.0:1787430801.179858:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836197888 00000100:00100000:1.0:1787430801.179865:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836197888 00000100:00100000:1.0:1787430801.179920:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:1.0:1787430801.179930:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:11135:x1874256836197888:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430801.179950:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430801.179967:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94397 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913889e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.180061:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9439e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.180075:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9439e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.180086:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9439e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430801.180098:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787430801.180210:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94397 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913889e expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.180244:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9439e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913889e expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.180254:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:1.0:1787430801.180257:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787430801.180260:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360eea00, rc 0) 00000100:00100000:1.0:1787430801.180409:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11135:x1874256836197888:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 481us (2356us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787430801.180417:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:3.0:1787430801.195209:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430801.195304:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836198144 00000100:00100000:0.0:1787430801.195314:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836198144 00000100:00100000:0.0:1787430801.195374:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:0.0:1787430801.195387:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836198144:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:0.0:1787430801.195437:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.195483:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.195493:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430801.195498:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430801.195503:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.195554:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.195594:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 7 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430801.195805:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1874256847802752:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430801.195911:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c2e24ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430801.199302:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1874256847802752:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430801.199336:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430801.201356:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430801.207947:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836198272 00000100:00100000:1.0:1787430801.207964:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836198272 00002000:00100000:1.0:1787430801.208022:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8e2b03b18380 x1874256836198272/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:22/0 lens 504/0 e 0 to 0 dl 1787430812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430801.208033:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b03b18380 with x1874256836198272 ext(0->12) 00010000:00010000:1.0:1787430801.208043:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 8 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.208060:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 8 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430801.208069:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2b03b18380 00000100:00100000:1.0:1787430801.208131:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:1.0:1787430801.208142:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836198272:12345-192.168.202.25@tcp:4:lfs.0 00000001:00100000:0.0:1787430801.214705:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000100:00100000:1.0:1787430801.216018:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2399:x1874256836198272:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 7868us (14661us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787430801.216032:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00002000:00100000:1.0:1787430801.216045:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8e2b03b18380 x1874256836198272/t4294967300(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:22/0 lens 504/448 e 0 to 0 dl 1787430812 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430801.216056:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b03b18380 with x1874256836198272 ext(0->12) 00010000:00010000:1.0:1787430801.216066:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 9 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.216084:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 9 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430801.216093:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2b03b18380 00000100:00100000:0.0:1787430801.224998:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430801.225146:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836198400 00000100:00100000:1.0:1787430801.225169:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836198400 00010000:00010000:1.0:1787430801.225213:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 9 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430801.225257:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:1.0:1787430801.225269:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2400:x1874256836198400:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430801.225284:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787430801.225301:0:6482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787430801.225304:0:6482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787430800 00002000:00010000:1.0:1787430801.225318:0:6482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787430801 00002000:00010000:1.0:1787430801.225320:0:6482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787430800 00002000:00010000:1.0:1787430801.225323:0:6482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787430801.225330:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 9 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.225346:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 9 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.225368:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a9435f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138882 expref: 9 pid: 8409 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.225386:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430801.225390:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430801.225396:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.225406:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.225441:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430801.225512:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836198400:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 244us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430801.225527:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00010000:00010000:2.0:1787430801.226123:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226144:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226182:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226191:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226199:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226206:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430801.226211:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226220:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226234:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.226242:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b89810/0x4dbb683ba6a943ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430801.226317:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836198144:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 30932us (31117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430801.226326:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:0.0:1787430801.231870:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430801.232026:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836198656 00000100:00100000:1.0:1787430801.232037:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836198656 00000100:00100000:1.0:1787430801.232101:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:1.0:1787430801.232111:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11135:x1874256836198656:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:1.0:1787430801.232200:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9439e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913889e expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430801.232410:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1787430801.232470:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787430801.233359:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1787430801.233405:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.233424:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 26 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.233434:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.233784:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 26 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.233802:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 26 pid: 6499 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430801.233819:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1874256847802880:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430801.234039:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430801.255104:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430801.255204:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836198784 00000100:00100000:2.0:1787430801.255215:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836198784 00010000:00010000:2.0:1787430801.255257:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 27 pid: 6499 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430801.255303:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1787430801.255314:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:2399:x1874256836198784:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430801.255329:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430801.255338:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 27 pid: 6499 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.255353:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 27 pid: 6499 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.255376:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:2.0:1787430801.255383:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.255393:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.255400:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.255440:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430801.255520:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:2399:x1874256836198784:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 206us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430801.255528:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00010000:00010000:1.0:1787430801.262046:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94343 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138874 expref: 26 pid: 6499 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430801.262075:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1874256847802880:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430801.262099:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.271429:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.271869:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430801.272371:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787430801.273095:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787430801.273206:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847803008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787430801.273274:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430801.273410:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1842c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787430801.278140:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847803008 00000100:00100000:0.0:1787430801.278156:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847803008 00000100:00100000:0.0:1787430801.278288:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787430801.278302:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1874256847803008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787430801.278493:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1874256847803008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 195us (5218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430801.278502:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787430801.280482:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847803008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787430801.280834:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1787430801.280920:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847803136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787430801.280991:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430801.282018:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430801.282858:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847803136 00000100:00100000:1.0:1787430801.282871:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847803136 00000100:00100000:1.0:1787430801.283263:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787430801.283275:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11518050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1874256847803136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787430801.283823:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11518050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6501:x1874256847803136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 548us (2828us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787430801.283832:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787430801.284008:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847803136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787430801.284090:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787430801.284138:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.284149:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.284185:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.284190:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430801.284195:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.284202:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.284218:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:2.0:1787430801.284220:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787430801.284225:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.284230:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430801.284344:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787430801.284408:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787430801.284419:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 262756816881ns, next at 263756814823ns, rc = 0 00000001:00080000:2.0:1787430801.284426:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1787430801.284468:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:2.0:1787430801.284472:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787430801.284478:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9439e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913889e expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430801.284649:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11135:x1874256836198656:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 52538us (52787us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787430801.284668:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000020:00080000:2.0:1787430801.284673:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787430801.293979:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430801.294120:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836198912 00000100:00100000:3.0:1787430801.294130:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836198912 00000100:00100000:3.0:1787430801.294731:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:3.0:1787430801.294748:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11135:x1874256836198912:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430801.294774:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430801.294798:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a943ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388a5 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.294862:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a943ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388a5 expref: 30 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.294948:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a943ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388a5 expref: 30 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430801.294972:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430801.294976:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430801.294980:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:3.0:1787430801.295120:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11135:x1874256836198912:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 376us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430801.295128:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:2.0:1787430801.301424:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430801.301720:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836199168 00000100:00100000:0.0:1787430801.301731:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836199168 00000100:00100000:0.0:1787430801.301800:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1787430801.301811:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e59850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11135:x1874256836199168:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430801.302073:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e59850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+31:11135:x1874256836199168:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 263us (661us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787430801.302081:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00010000:00010000:3.0:1787430801.407904:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430801.485054:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430801.485838:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836199424 00000100:00100000:2.0:1787430801.485849:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836199424 00000100:00100000:2.0:1787430801.486084:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1787430801.486112:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+31:11145:x1874256836199424:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430801.486301:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430801.486356:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a943c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388ac expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430801.486478:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787430801.487295:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a943c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388ac expref: 33 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.487312:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:2.0:1787430801.487315:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430801.487339:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a943c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388ac expref: 33 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.487353:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03000, rc 0) 00000100:00100000:2.0:1787430801.487435:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11145:x1874256836199424:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1325us (2391us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1787430801.487442:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:0.0:1787430801.493960:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430801.494069:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836199552 00000100:00100000:1.0:1787430801.494080:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836199552 00000100:00100000:1.0:1787430801.494341:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:1.0:1787430801.494353:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11145:x1874256836199552:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:1.0:1787430801.494465:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.494483:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.494495:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.494508:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495024:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495034:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495147:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495157:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495164:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430801.495224:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495238:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495245:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495251:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495256:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eea00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430801.495260:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495267:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495279:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:1.0:1787430801.495282:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430801.495286:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495297:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a943cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495311:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495316:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495321:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495326:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430801.495329:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495334:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495341:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2c11493200) 00010000:00010000:1.0:1787430801.495344:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430801.495346:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495351:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a943d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495360:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495366:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495378:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495383:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430801.495386:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495392:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495400:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:1.0:1787430801.495402:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430801.495405:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430801.495411:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a943dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430801.495965:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11145:x1874256836199552:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 1171us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430801.495974:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:3.0:1787430801.498507:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430801.499794:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836199808 00000100:00100000:0.0:1787430801.499806:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836199808 00000100:00100000:0.0:1787430801.499989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1787430801.500002:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11145:x1874256836199808:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430801.500259:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:11145:x1874256836199808:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 260us (1760us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787430801.500266:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:3.0:1787430801.596755:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430801.598758:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836200064 00000100:00100000:0.0:1787430801.598774:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836200064 00000100:00100000:2.0:1787430801.599247:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:2.0:1787430801.599260:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:11148:x1874256836200064:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430801.599298:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430801.599319:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a943e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388b3 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599406:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599422:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599436:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599466:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599474:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599480:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599764:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599774:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599782:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430801.599792:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787430801.599955:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599964:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599970:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599976:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430801.599980:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.599987:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600000:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430801.600003:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430801.600007:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600013:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a943eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600026:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600031:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600037:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600053:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430801.600056:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600062:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600071:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2c11493200) 00010000:00010000:2.0:1787430801.600073:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430801.600076:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600082:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a943f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600288:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a943e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 36 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600302:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 35 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430801.600310:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430801.600313:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430801.600315:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03200, rc 0) 00000100:00100000:2.0:1787430801.600392:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11148:x1874256836200064:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1135us (3645us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787430801.600400:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:3.0:1787430801.605893:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430801.608042:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836200192 00000100:00100000:0.0:1787430801.608058:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836200192 00000100:00100000:0.0:1787430801.608305:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1787430801.608324:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11148:x1874256836200192:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:0.0:1787430801.608427:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.608791:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.608807:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.608859:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.609081:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.609243:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.609265:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430801.609270:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.609278:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.609301:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430801.609305:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430801.609310:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430801.609323:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430801.610068:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11148:x1874256836200192:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 1742us (4198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430801.610078:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1787430801.613215:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430801.613420:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836200448 00000100:00100000:2.0:1787430801.613513:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836200448 00000100:00100000:2.0:1787430801.613824:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:2.0:1787430801.613837:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11148:x1874256836200448:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430801.614452:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+36:11148:x1874256836200448:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 608us (1239us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787430801.614470:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000040:00080000:2.0:1787430801.856586:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787430801.858222:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787430802.392193:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430802.392638:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836200704 00000100:00100000:2.0:1787430802.392650:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836200704 00000100:00100000:2.0:1787430802.392737:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:2.0:1787430802.392751:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+36:11180:x1874256836200704:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:2.0:1787430802.392776:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430802.392799:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a9440e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388ba expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.392903:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.392916:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.392927:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430802.392938:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787430802.393061:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a9440e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388ba expref: 39 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.393079:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388ba expref: 38 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.393102:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430802.393105:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430802.393109:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03c00, rc 0) 00000100:00100000:2.0:1787430802.393162:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:11180:x1874256836200704:12345-192.168.202.25@tcp:101:cat.0 Request processed in 415us (979us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787430802.393169:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00080000:3.0:1787430802.393339:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430802.397692:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430802.397811:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836200832 00000100:00100000:2.0:1787430802.397823:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836200832 00000100:00100000:2.0:1787430802.397906:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:2.0:1787430802.397918:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:2400:x1874256836200832:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430802.397932:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430802.397956:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388ba expref: 38 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.397977:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430802.397983:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430802.398034:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:2400:x1874256836200832:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 118us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430802.398043:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:3.0:1787430802.400306:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430802.400482:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836201088 00000100:00100000:0.0:1787430802.400491:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836201088 00000100:00100000:0.0:1787430802.400545:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:0.0:1787430802.400555:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:11180:x1874256836201088:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:0.0:1787430802.400853:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:11180:x1874256836201088:12345-192.168.202.25@tcp:35:cat.0 Request processed in 299us (553us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787430802.400862:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00010000:00010000:3.0:1787430802.432061:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430802.598895:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430802.599042:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836201344 00000100:00100000:3.0:1787430802.599054:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836201344 00000100:00100000:3.0:1787430802.599117:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:3.0:1787430802.599127:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:11186:x1874256836201344:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1787430802.599152:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430802.599155:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787430802.599183:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9437b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138890 expref: 38 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.599203:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430802.599209:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430802.599223:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94423 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388c1 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.599361:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.599377:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 38 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.599387:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.599442:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 38 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.599477:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 38 pid: 8819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430802.599491:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1874256847803264:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430802.599654:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430802.602381:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430802.602494:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836201472 00000100:00100000:0.0:1787430802.602504:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836201472 00010000:00010000:0.0:1787430802.602545:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 39 pid: 8819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430802.602590:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1787430802.602638:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:2400:x1874256836201472:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430802.602652:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430802.602659:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 39 pid: 8819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430802.602673:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 39 pid: 8819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430802.602694:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430802.602698:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430802.602708:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430802.602715:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430802.602734:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430802.602785:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:2400:x1874256836201472:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 186us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430802.602792:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00010000:00010000:2.0:1787430802.603140:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a943f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388b3 expref: 38 pid: 8819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430802.603159:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1874256847803264:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430802.603180:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.603203:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.603209:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430802.603226:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787430802.603375:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94423 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 39 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.603391:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 38 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.603400:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430802.603403:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787430802.603405:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8aa00, rc 0) 00000100:00100000:2.0:1787430802.603443:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:11186:x1874256836201344:12345-192.168.202.25@tcp:101:dd.0 Request processed in 4317us (4558us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787430802.603466:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:1.0:1787430802.626498:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430802.626648:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836201600 00000100:00100000:3.0:1787430802.626659:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836201600 00000100:00100000:3.0:1787430802.626722:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:3.0:1787430802.626733:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:11186:x1874256836201600:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1787430802.626759:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430802.626781:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94438 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388c8 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.626818:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.626832:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.626844:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.626975:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94438 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 40 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.627005:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 39 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430802.627015:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430802.627018:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430802.627021:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:3.0:1787430802.627074:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:11186:x1874256836201600:12345-192.168.202.25@tcp:101:dd.0 Request processed in 343us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430802.627082:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:3.0:1787430802.632805:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430802.650654:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836201856 00000100:00100000:2.0:1787430802.650672:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836201856 00000100:00100000:2.0:1787430802.650757:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:2.0:1787430802.650770:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:11186:x1874256836201856:12345-192.168.202.25@tcp:36:dd.0 00010000:00010000:2.0:1787430802.651008:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.651028:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.651055:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430802.651099:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1787430802.651123:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003db12509 reply state 000000007a6f6af2 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.651136:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430802.651144:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430802.651147:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787430802.651150:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430802.651797:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:11186:x1874256836201856:12345-192.168.202.25@tcp:36:dd.0 Request processed in 1026us (18999us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787430802.651806:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00000020:00080000:2.0:1787430802.651811:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787430803.199886:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430803.199909:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430803.199921:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c1157ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847803392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430803.199945:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847803520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430803.200036:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430803.200038:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430803.200050:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847803648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430803.200089:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.200123:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847803520 00000100:00100000:1.0:1787430803.200132:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847803520 00000100:00100000:2.0:1787430803.200144:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847803648 00000100:00100000:2.0:1787430803.200150:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847803648 00000100:00100000:2.0:1787430803.200193:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787430803.200202:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847803648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430803.200229:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430803.200270:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847803648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430803.200277:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787430803.200305:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787430803.200312:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847803520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430803.200324:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430803.200370:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847803520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430803.200376:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787430803.204148:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847803648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430803.204267:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847803520:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787430803.204297:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430803.296140:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430803.296223:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847803392 00000100:00100000:3.0:1787430803.296232:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847803392 00000100:00100000:2.0:1787430803.296306:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787430803.296320:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847803392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787430803.296359:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787430803.296453:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847803392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430803.296462:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787430803.296566:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c1157ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847803392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430803.335564:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430803.336164:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836201984 00000100:00100000:3.0:1787430803.336174:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836201984 00000100:00100000:2.0:1787430803.336428:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:2.0:1787430803.336451:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:11200:x1874256836201984:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:2.0:1787430803.336477:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430803.336497:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9444d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388cf expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336584:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336617:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336630:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336679:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336694:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336701:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336802:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336981:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.336991:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.337024:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.337038:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 43 pid: 6499 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430803.337052:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847803776:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430803.337154:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430803.341772:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430803.341817:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847803776:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430803.341843:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430803.343776:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836202240 00000100:00100000:1.0:1787430803.343798:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836202240 00000100:00100000:1.0:1787430803.343875:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:1.0:1787430803.343887:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+44:6160:x1874256836202240:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787430803.344210:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+45:6160:x1874256836202240:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 325us (2450us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787430803.344218:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000001:00080000:1.0:1787430803.355749:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:1.0:1787430803.355786:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787430803.355915:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.355930:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.355959:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.355965:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430803.355970:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.355978:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.355995:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e2c1847b600) 00010000:00010000:2.0:1787430803.355998:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430803.356003:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356009:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a942f6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356028:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356034:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356039:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356044:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430803.356047:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356061:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356069:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430803.356071:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430803.356074:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356079:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a942fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356095:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356100:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356105:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356110:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430803.356112:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356118:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356125:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2c11493200) 00010000:00010000:2.0:1787430803.356128:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430803.356130:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356142:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a9433c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356154:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356160:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356166:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356170:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430803.356173:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356178:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356186:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430803.356189:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430803.356192:0:3613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356201:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.356207:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94446 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430803.367683:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847803904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787430803.367772:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430803.367985:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847803904 00000100:00100000:0.0:1787430803.367994:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847803904 00000100:00100000:0.0:1787430803.368100:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000020:00080000:1.0:1787430803.368107:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2c1842c000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787430803.368116:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2c1842c240 00000100:00100000:0.0:1787430803.368116:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847803904:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1787430803.368122:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2c35ecb400 00002000:00080000:0.0:1787430803.368147:0:8830:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00000020:00080000:1.0:1787430803.368168:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00002000:00010000:0.0:1787430803.368180:0:8830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8a0790, atime: 0x6a8a0791, ctime: 0x6a8a0790, blocks: 0x8 00010000:00010000:0.0:1787430803.368190:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.368207:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=264s v=(0 0) 00010000:00010000:0.0:1787430803.368213:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430803.368221:0:8830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.368241:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.368252:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.368261:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.368278:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787430803.368459:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430803.368567:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847803904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 457us (794us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787430803.368577:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787430803.368579:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430803.368592:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.368623:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1de00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430803.368628:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.368638:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.368657:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.368665:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000619d53d0/0x4dbb683ba6a94469 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430803.368692:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430803.368695:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430803.368697:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787430803.368998:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b03d9d180/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787430803.369006:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847803904:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1787430803.370798:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787430803.373470:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430803.373592:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836202368 00000100:00100000:0.0:1787430803.373706:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836202368 00010000:00010000:0.0:1787430803.373752:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 14 pid: 6499 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430803.373839:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:0.0:1787430803.373851:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:2399:x1874256836202368:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430803.373869:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430803.373876:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 14 pid: 6499 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.373889:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 14 pid: 6499 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.373912:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a9442a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c1 expref: 14 pid: 6499 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.373927:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430803.373931:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.373956:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.373963:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.374017:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430803.374077:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2399:x1874256836202368:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 228us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430803.374085:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00010000:00010000:3.0:1787430803.374135:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374144:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430803.374196:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787430803.374201:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430803.374242:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374255:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374266:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374272:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374279:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374286:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430803.374338:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374347:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374357:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430803.374365:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430803.374370:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374376:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94454 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374388:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374394:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374401:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374406:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430803.374409:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374415:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374423:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2c11493200) 00010000:00010000:3.0:1787430803.374425:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430803.374428:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374433:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9445b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374481:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9444d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388cf expref: 13 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374507:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388cf expref: 12 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.374515:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430803.374517:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430803.374519:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02200, rc 0) 00000100:00100000:3.0:1787430803.374560:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:11200:x1874256836201984:12345-192.168.202.25@tcp:101:stat.0 Request processed in 38122us (39005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430803.374568:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00010000:00010000:1.0:1787430803.455948:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430803.535734:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430803.535864:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836202624 00000100:00100000:3.0:1787430803.535874:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836202624 00000100:00100000:3.0:1787430803.535964:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1787430803.535975:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:11206:x1874256836202624:12345-192.168.202.25@tcp:36:truncate.0 00010000:00010000:3.0:1787430803.536031:0:8819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430803.536058:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388cf expref: 12 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.536077:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430803.536082:0:8819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430803.536245:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.536259:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.536269:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430803.536426:0:8819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787430803.536459:0:8819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1a0e29a reply state 000000006880f250 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.536472:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430803.536479:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430803.536482:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430803.536485:0:8819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430803.536708:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:11206:x1874256836202624:12345-192.168.202.25@tcp:36:truncate.0 Request processed in 734us (983us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787430803.536716:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000020:00080000:3.0:1787430803.536720:0:8819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787430803.979932:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430803.980275:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836202752 00000100:00100000:0.0:1787430803.980285:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836202752 00000100:00100000:0.0:1787430803.980357:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:0.0:1787430803.980370:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:11220:x1874256836202752:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:0.0:1787430803.980394:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430803.980413:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94477 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388d6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980504:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980530:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980541:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980557:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980564:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980570:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980688:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980697:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980705:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430803.980744:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787430803.980748:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430803.980767:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980778:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980786:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980791:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980797:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980802:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430803.980820:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980827:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.980845:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430803.980848:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430803.981574:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981584:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a9447e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981643:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981652:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981658:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981664:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1de00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430803.981667:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981673:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981683:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33900) 00010000:00010000:0.0:1787430803.981686:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430803.981689:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981695:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981743:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94477 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981757:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430803.981764:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430803.981767:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430803.981769:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d800, rc 0) 00000100:00100000:0.0:1787430803.981841:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:11220:x1874256836202752:12345-192.168.202.25@tcp:101:stat.0 Request processed in 1473us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430803.981848:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:2.0:1787430804.210619:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430804.212494:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836203008 00000100:00100000:3.0:1787430804.212508:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836203008 00000100:00100000:3.0:1787430804.212618:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1787430804.212629:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:11230:x1874256836203008:12345-192.168.202.25@tcp:101:lfs.0 00000100:00080000:1.0:1787430804.212632:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430804.212652:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430804.212674:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388dd expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430804.212826:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787430804.212985:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94493 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388dd expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.213000:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:3.0:1787430804.213003:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430804.213023:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388dd expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.213038:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a600, rc 0) 00000100:00100000:3.0:1787430804.213104:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11230:x1874256836203008:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 478us (2508us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1787430804.213111:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:1.0:1787430804.216016:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430804.216151:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836203264 00000100:00100000:0.0:1787430804.216160:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836203264 00000100:00100000:0.0:1787430804.216212:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:0.0:1787430804.216224:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11230:x1874256836203264:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430804.216443:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:11230:x1874256836203264:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 212us (426us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787430804.216452:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:1.0:1787430804.258906:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430804.259073:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836203520 00000100:00100000:0.0:1787430804.259083:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836203520 00000100:00100000:0.0:1787430804.259149:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:0.0:1787430804.259161:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:11236:x1874256836203520:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430804.259185:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430804.259205:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a944a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388e4 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.259325:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.259343:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.259351:0:13789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.259386:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.259399:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 18 pid: 6498 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430804.259412:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13789:1874256847804032:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430804.259532:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12bbb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430804.263455:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.263509:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836203648 00000100:00100000:2.0:1787430804.263520:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836203648 00010000:00010000:2.0:1787430804.263583:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 19 pid: 6498 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430804.263678:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:2.0:1787430804.263703:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11442850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:2399:x1874256836203648:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430804.263718:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430804.263726:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 19 pid: 6498 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.263740:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 19 pid: 6498 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.263763:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430804.263768:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.263778:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.263785:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.263802:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430804.264064:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11442850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:2399:x1874256836203648:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 362us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430804.264072:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00010000:00010000:0.0:1787430804.264318:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9448c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388d6 expref: 18 pid: 6498 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430804.264352:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13789:1874256847804032:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430804.264372:0:13789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.264382:0:13789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.264401:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430804.264421:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787430804.264579:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a944a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 19 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.264596:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 18 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.264712:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430804.264716:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787430804.264719:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1de00, rc 0) 00000100:00100000:0.0:1787430804.264752:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:11236:x1874256836203520:12345-192.168.202.25@tcp:101:bash.0 Request processed in 5594us (5854us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787430804.264760:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:1.0:1787430804.282057:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430804.282144:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836203904 00000100:00100000:0.0:1787430804.282155:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836203904 00000100:00100000:0.0:1787430804.282248:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:0.0:1787430804.282259:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:11236:x1874256836203904:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:0.0:1787430804.283752:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.285342:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.285357:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430804.290968:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1787430804.291042:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e47c11e reply state 00000000f6a7f315 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.291065:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.291094:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:1.0:1787430804.291097:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787430804.291100:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430804.291356:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:11236:x1874256836203904:12345-192.168.202.25@tcp:36:bash.0 Request processed in 9094us (9304us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787430804.291366:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000020:00080000:1.0:1787430804.291371:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787430804.300828:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.301021:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836204032 00000100:00100000:2.0:1787430804.301032:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836204032 00000100:00100000:2.0:1787430804.301093:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:2.0:1787430804.301104:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:11236:x1874256836204032:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430804.301128:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430804.301149:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a944bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388eb expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.301250:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.301265:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 22 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.301275:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.301310:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 22 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.301324:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 22 pid: 13789 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430804.301338:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847804160:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430804.301456:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787430804.304573:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430804.305126:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847804160:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430804.305153:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430804.306061:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836204160 00000100:00100000:1.0:1787430804.306069:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836204160 00010000:00010000:1.0:1787430804.306111:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 23 pid: 13789 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430804.306187:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:1.0:1787430804.306198:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2400:x1874256836204160:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430804.306214:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430804.306220:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 23 pid: 13789 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.306233:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 23 pid: 13789 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.306254:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388e4 expref: 23 pid: 13789 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.306270:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:1.0:1787430804.306275:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.306298:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.306306:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430804.306358:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430804.306411:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:2400:x1874256836204160:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 215us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430804.306440:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00010000:00010000:0.0:1787430804.306671:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.306679:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430804.306732:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787430804.306736:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430804.306756:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.306803:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a944bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388eb expref: 22 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.306817:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388eb expref: 21 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.306824:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430804.306827:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430804.306830:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02e00, rc 0) 00000100:00100000:0.0:1787430804.306870:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:11236:x1874256836204032:12345-192.168.202.25@tcp:101:bash.0 Request processed in 5768us (6052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.306878:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:0.0:1787430804.310343:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.310499:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836204416 00000100:00100000:2.0:1787430804.310510:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836204416 00000100:00100000:2.0:1787430804.310953:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:2.0:1787430804.310964:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e5b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:11236:x1874256836204416:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:2.0:1787430804.311189:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e5b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11236:x1874256836204416:12345-192.168.202.25@tcp:35:bash.0 Request processed in 226us (855us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787430804.311197:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1787430804.404264:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430804.404709:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836204672 00000100:00100000:3.0:1787430804.404721:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836204672 00000100:00100000:3.0:1787430804.404792:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:3.0:1787430804.404803:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11246:x1874256836204672:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430804.404827:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430804.404849:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a944cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388f2 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430804.404952:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787430804.405057:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a944cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388f2 expref: 24 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.405076:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:3.0:1787430804.405079:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430804.405084:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a944cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388f2 expref: 24 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.405122:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a600, rc 0) 00000100:00100000:3.0:1787430804.405197:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:11246:x1874256836204672:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 396us (942us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1787430804.405205:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00010000:00010000:3.0:1787430804.481140:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430804.481700:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.481739:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.481769:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.481805:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.481830:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.481865:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.481888:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836204928 00000100:00100000:0.0:1787430804.481972:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836204800 00000100:00100000:0.0:1787430804.481982:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836204800 00000100:00100000:0.0:1787430804.482026:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836205056 00000100:00100000:0.0:1787430804.482035:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836205056 00000100:00100000:0.0:1787430804.482076:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836205312 00000100:00100000:0.0:1787430804.482079:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836205312 00000100:00100000:0.0:1787430804.482114:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836205440 00000100:00100000:0.0:1787430804.482117:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836205440 00000100:00100000:0.0:1787430804.482147:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:0.0:1787430804.482174:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836205056:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430804.482244:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836205056:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 88us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.482252:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:0.0:1787430804.482268:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:0.0:1787430804.482274:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836205312:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430804.482297:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836205312:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.482303:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:0.0:1787430804.482315:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:0.0:1787430804.482322:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836205440:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430804.482344:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836205440:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.482351:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:0.0:1787430804.482362:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:0.0:1787430804.482368:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:11246:x1874256836204800:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:0.0:1787430804.482425:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482535:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482554:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482570:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482577:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482583:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482681:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482691:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482698:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430804.482743:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482755:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482761:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482768:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482783:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1c000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430804.482787:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482795:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482807:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430804.482809:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430804.482814:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482819:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a944d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482837:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482843:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482848:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482853:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430804.482855:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482860:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482878:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33900) 00010000:00010000:0.0:1787430804.482880:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430804.482883:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.482889:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a944e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430804.483072:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836205184 00000100:00100000:1.0:1787430804.483078:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836205184 00000100:00100000:1.0:1787430804.483111:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:1.0:1787430804.483119:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836205184:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430804.483169:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836205184:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 38us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430804.483177:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:2.0:1787430804.483267:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836204928 00000100:00100000:2.0:1787430804.483302:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 360 00000100:00100000:2.0:1787430804.483309:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836204928:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430804.483335:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836204928:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430804.483341:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 360 00010000:00010000:0.0:1787430804.483392:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.483399:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.483404:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.483408:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1de00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430804.483411:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.483416:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.483424:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430804.483427:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430804.483441:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.483447:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a944e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430804.483492:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:11246:x1874256836204800:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 1123us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.483498:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00080000:1.0:1787430804.484761:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430804.484769:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430804.484772:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430804.486868:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.489078:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836205696 00000100:00100000:2.0:1787430804.489092:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836205696 00000100:00100000:2.0:1787430804.489168:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:2.0:1787430804.489181:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:11246:x1874256836205696:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430804.489984:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:11246:x1874256836205696:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 804us (3121us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787430804.489993:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1787430804.516456:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430804.516702:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836205952 00000100:00100000:3.0:1787430804.516713:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836205952 00000100:00100000:3.0:1787430804.516783:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:3.0:1787430804.516805:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:11249:x1874256836205952:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430804.516829:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430804.516858:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a944ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91388f9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517069:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517084:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517095:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517111:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517118:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517136:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517342:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517352:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517360:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430804.517369:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787430804.517557:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517567:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517573:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517580:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8aa00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430804.517584:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517591:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517735:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430804.517739:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430804.517753:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517759:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a944f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517771:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517777:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517782:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517799:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430804.517802:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517808:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517816:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2c132d1900) 00010000:00010000:3.0:1787430804.517819:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430804.517821:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.517827:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a944fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.518629:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a944ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388f9 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.518649:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388f9 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.518657:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430804.518660:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430804.518663:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491200, rc 0) 00000100:00100000:0.0:1787430804.518733:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:11249:x1874256836205952:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1939us (2287us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787430804.518741:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:1.0:1787430804.526380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430804.526467:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836206080 00000100:00100000:0.0:1787430804.526479:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836206080 00000100:00100000:0.0:1787430804.526568:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:0.0:1787430804.526579:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:2400:x1874256836206080:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430804.526596:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430804.526659:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388f9 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.526679:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430804.526696:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430804.526755:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:2400:x1874256836206080:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 179us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.526762:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1787430804.529683:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.529817:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836206208 00000100:00100000:2.0:1787430804.529826:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836206208 00000100:00100000:2.0:1787430804.529901:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:2.0:1787430804.529912:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:11249:x1874256836206208:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:2.0:1787430804.529972:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.529989:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530015:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530052:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530060:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530067:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530074:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430804.530078:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530085:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530096:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430804.530099:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430804.530103:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.530110:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430804.530465:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:11249:x1874256836206208:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 554us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430804.530474:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:1.0:1787430804.534077:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430804.534149:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836206464 00000100:00100000:0.0:1787430804.534169:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836206464 00000100:00100000:0.0:1787430804.534222:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1787430804.534232:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:11249:x1874256836206464:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430804.534705:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:11249:x1874256836206464:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 472us (636us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787430804.534713:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1787430804.718355:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430804.718492:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836206720 00000100:00100000:3.0:1787430804.718503:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836206720 00000100:00100000:3.0:1787430804.718572:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:3.0:1787430804.718596:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:11267:x1874256836206720:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:0.0:1787430804.718895:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430804.718920:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94518 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138900 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.719041:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9451f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.719057:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9451f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.719071:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9451f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430804.719083:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787430804.719209:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94518 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138900 expref: 29 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.719227:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9451f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138900 expref: 28 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.719242:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430804.719245:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787430804.719249:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1d800, rc 0) 00000100:00100000:0.0:1787430804.719311:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11267:x1874256836206720:12345-192.168.202.25@tcp:101:cat.0 Request processed in 716us (968us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787430804.719320:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:1.0:1787430804.789367:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430804.789478:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836206848 00000100:00100000:0.0:1787430804.789489:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836206848 00000100:00100000:0.0:1787430804.789568:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:0.0:1787430804.789578:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11268:x1874256836206848:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430804.789633:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430804.789655:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a9452d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138907 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.789723:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94534 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.789747:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.789759:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430804.789805:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787430804.789808:0:8819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430804.789826:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.790123:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a9452d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138907 expref: 30 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.790142:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138907 expref: 29 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.790151:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430804.790154:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430804.790158:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f1c000, rc 0) 00000100:00100000:0.0:1787430804.790222:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11268:x1874256836206848:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 645us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.790229:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:1.0:1787430804.797777:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.797900:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836207232 00000100:00100000:2.0:1787430804.797918:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836207232 00000100:00100000:2.0:1787430804.797976:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:2.0:1787430804.797986:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11268:x1874256836207232:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430804.798289:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11268:x1874256836207232:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 302us (522us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787430804.798297:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1787430804.807486:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.807697:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836207360 00000100:00100000:2.0:1787430804.807705:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836207360 00000100:00100000:2.0:1787430804.807758:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:2.0:1787430804.807765:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11268:x1874256836207360:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:2.0:1787430804.807778:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787430804.807798:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a944c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388eb expref: 30 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.807814:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a9451f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138900 expref: 29 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.807824:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a943ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388a5 expref: 28 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.807831:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430804.807835:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430804.807880:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:11268:x1874256836207360:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 115us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430804.807885:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1787430804.811730:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430804.811869:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836207488 00000100:00100000:3.0:1787430804.811880:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836207488 00000100:00100000:2.0:1787430804.812015:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:2.0:1787430804.812029:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:11268:x1874256836207488:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:2.0:1787430804.812490:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.812509:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.813262:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430804.813576:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430804.813745:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787430804.813878:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787430804.817251:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:11268:x1874256836207488:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 5212us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430804.817268:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:1.0:1787430804.855531:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430804.855994:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836207616 00000100:00100000:0.0:1787430804.856004:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836207616 00000100:00100000:0.0:1787430804.856063:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:0.0:1787430804.856073:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:11270:x1874256836207616:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430804.856090:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430804.856110:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94542 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913890e expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856180:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856192:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856204:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856228:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856236:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856242:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856302:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856309:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856314:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430804.856347:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787430804.856351:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430804.856365:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856375:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856382:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856388:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856402:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856408:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1c800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430804.856412:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856419:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856441:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430804.856444:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430804.856449:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856455:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c800/0x4dbb683ba6a94549 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856467:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856474:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856480:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856485:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430804.856488:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856505:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856513:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33900) 00010000:00010000:0.0:1787430804.856515:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430804.856517:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856523:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d800/0x4dbb683ba6a94550 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856549:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1de00/0x4dbb683ba6a94542 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 29 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856560:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 28 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430804.856567:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430804.856569:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430804.856571:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175200, rc 0) 00000100:00100000:0.0:1787430804.856649:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11270:x1874256836207616:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 577us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430804.856656:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 76 00000040:00080000:0.0:1787430804.930278:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430804.930287:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430804.930337:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787430804.930346:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430804.930489:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847804288:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787430804.930646:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12bbb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430804.936340:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847804288:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787430804.942089:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.942338:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836207744 00000100:00100000:2.0:1787430804.942350:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836207744 00000100:00100000:2.0:1787430804.942443:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:2.0:1787430804.942456:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11277:x1874256836207744:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787430804.942498:0:6496:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787430804.942658:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11277:x1874256836207744:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 204us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430804.942665:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:1.0:1787430804.959462:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430804.959560:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836207872 00000100:00100000:3.0:1787430804.959569:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836207872 00000100:00100000:3.0:1787430804.959669:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:3.0:1787430804.959681:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11277:x1874256836207872:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787430804.959746:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959763:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959774:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959923:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959933:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959941:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959970:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959979:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.959986:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430804.960045:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787430804.960049:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430804.960065:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960092:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960100:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960107:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960113:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430804.960117:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960124:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960138:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:3.0:1787430804.960141:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430804.960146:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960153:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9455e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960165:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960181:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960188:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960193:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430804.960196:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960202:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960211:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430804.960214:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430804.960217:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960223:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a94565 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960237:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960244:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960250:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960255:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430804.960264:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960270:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960291:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430804.960294:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430804.960297:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430804.960303:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a9456c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430804.960433:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11277:x1874256836207872:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 744us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430804.960441:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:1.0:1787430804.997250:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430804.998565:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836208128 00000100:00100000:2.0:1787430804.998579:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836208128 00000100:00100000:2.0:1787430804.998683:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:2.0:1787430804.998694:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11277:x1874256836208128:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430804.998715:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430804.998749:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94573 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138915 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.998877:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.998892:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.998905:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430804.998916:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787430804.998996:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999015:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999022:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999027:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430804.999032:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999039:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999053:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430804.999056:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430804.999061:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999077:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a9457a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999120:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94573 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138915 expref: 30 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999130:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:2.0:1787430804.999133:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430804.999136:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94573 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138915 expref: 30 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430804.999145:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02e00, rc 0) 00000100:00100000:2.0:1787430805.000053:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11277:x1874256836208128:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1355us (2807us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1787430805.000063:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:0.0:1787430805.003592:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.003821:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836208256 00000100:00100000:3.0:1787430805.003832:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836208256 00000100:00100000:3.0:1787430805.003889:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:3.0:1787430805.003898:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11277:x1874256836208256:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430805.003929:0:8819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787430805.004054:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11277:x1874256836208256:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 156us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.004062:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:0.0:1787430805.015125:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.015826:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836208512 00000100:00100000:2.0:1787430805.015837:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836208512 00000100:00100000:2.0:1787430805.015909:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:2.0:1787430805.015920:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11277:x1874256836208512:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430805.015939:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430805.015943:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787430805.015969:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1c000/0x4dbb683ba6a94534 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138907 expref: 29 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.015989:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430805.015994:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430805.016033:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94588 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913891c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430805.016415:0:6498:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787430805.016563:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a9458f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.016576:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a9458f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.016585:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a9458f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.016682:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94588 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913891c expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.016696:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a9458f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913891c expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.016703:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:2.0:1787430805.016706:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430805.016708:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03a00, rc 0) 00000100:00100000:2.0:1787430805.016763:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11277:x1874256836208512:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 845us (1648us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787430805.016770:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:1.0:1787430805.022833:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.022915:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836208768 00000100:00100000:2.0:1787430805.022925:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836208768 00000100:00100000:2.0:1787430805.022986:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:2.0:1787430805.022997:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11277:x1874256836208768:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787430805.023079:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430805.023106:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a9458f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913891c expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023125:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c11493900) 00010000:00010000:2.0:1787430805.023134:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430805.023155:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023179:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023189:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023245:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023253:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023259:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023306:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023313:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023319:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023332:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430805.023336:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023344:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023353:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430805.023355:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430805.023359:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023365:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9459d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023374:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023380:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023387:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023391:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430805.023394:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023399:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023416:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x6cf23057 (ffff8e2c11493600) 00010000:00010000:2.0:1787430805.023418:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430805.023421:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.023440:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6cf23057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430805.023519:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11277:x1874256836208768:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 523us (696us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787430805.023526:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:0.0:1787430805.032546:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.045127:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836208896 00000100:00100000:3.0:1787430805.045143:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836208896 00000100:00100000:3.0:1787430805.045981:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:3.0:1787430805.046029:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11277:x1874256836208896:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430805.046098:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430805.046121:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138923 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.046290:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.046305:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.046317:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.046457:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 31 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.046476:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 30 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.046484:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430805.046487:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430805.046491:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491400, rc 0) 00000100:00100000:3.0:1787430805.046564:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11277:x1874256836208896:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 561us (14026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.046571:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:1.0:1787430805.068466:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.068561:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836209152 00000100:00100000:2.0:1787430805.068581:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836209152 00000100:00100000:2.0:1787430805.068676:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:2.0:1787430805.068685:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11277:x1874256836209152:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787430805.068767:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.068784:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.068804:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430805.069029:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1787430805.069040:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 266541437373ns, next at 267541434948ns, rc = 0 00000004:00010000:2.0:1787430805.069090:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1373319 reply state 00000000212013b0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.069124:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.069133:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:2.0:1787430805.069136:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787430805.069139:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430805.069468:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11277:x1874256836209152:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 782us (1010us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787430805.069476:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:1.0:1787430805.083727:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.083821:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836209280 00000100:00100000:2.0:1787430805.083830:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836209280 00000100:00100000:2.0:1787430805.083900:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:2.0:1787430805.083911:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11277:x1874256836209280:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430805.083934:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430805.083955:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913892a expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.084023:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 33 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.084038:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 33 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.084058:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:2.0:1787430805.084061:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430805.084065:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02e00, rc 0) 00000100:00100000:2.0:1787430805.084173:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:11277:x1874256836209280:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 263us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.084206:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:3.0:1787430805.088580:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.092332:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836209408 00000100:00100000:2.0:1787430805.092347:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836209408 00000100:00100000:2.0:1787430805.092404:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:2.0:1787430805.092420:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874256836209408:12345-192.168.202.25@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787430805.092461:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1787430805.092493:0:8411:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a945c7 00002000:00100000:2.0:1787430805.092506:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 419b0c27-15f9-4e73-995a-bc02788ae1b0/ffff8e2c3f91d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430805.092524:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787430805.092643:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787430805.092677:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f919800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430805.092745:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836209408:12345-192.168.202.25@tcp:8:lhsmtool_posix.0 Request processed in 324us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.092753:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:3.0:1787430805.098963:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430805.099116:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836209536 00000100:00100000:0.0:1787430805.099127:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836209536 00000100:00100000:0.0:1787430805.099214:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:0.0:1787430805.099226:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836209536:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787430805.100237:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787430805.101660:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1787430805.101681:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000100:00100000:0.0:1787430805.104037:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:0:x1874256836209536:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 4805us (5075us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787430805.104049:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:0.0:1787430805.115096:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.115495:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836209792 00000100:00100000:2.0:1787430805.115511:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836209792 00000100:00100000:2.0:1787430805.115580:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1787430805.115591:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:11277:x1874256836209792:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787430805.115851:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11277:x1874256836209792:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 249us (753us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787430805.115859:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1787430805.118659:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430805.118745:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836210048 00000100:00100000:0.0:1787430805.118755:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836210048 00000100:00100000:0.0:1787430805.118816:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:0.0:1787430805.118827:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11277:x1874256836210048:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787430805.118946:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11277:x1874256836210048:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430805.118953:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:3.0:1787430805.130069:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430805.130176:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836210176 00000100:00100000:0.0:1787430805.130189:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836210176 00000100:00100000:0.0:1787430805.130248:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:0.0:1787430805.130261:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11277:x1874256836210176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430805.130284:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430805.130319:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a945ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138931 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.130389:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a945d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.130404:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a945d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.130434:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a945d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430805.130484:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430805.130510:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a945d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.130540:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a945ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138931 expref: 36 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.130560:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a945d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138931 expref: 35 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.130569:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:0.0:1787430805.130572:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787430805.130577:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175800, rc 0) 00000100:00100000:0.0:1787430805.130717:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11277:x1874256836210176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 450us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430805.130725:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:0.0:1787430805.136055:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430805.136190:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836210304 00000100:00100000:1.0:1787430805.136200:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836210304 00000100:00100000:1.0:1787430805.136261:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:1.0:1787430805.136272:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836210304:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430805.136290:0:11754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430805.136317:0:11754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138938 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430805.136345:0:11754:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0795, blocks: 0x0 00010000:00010000:1.0:1787430805.136363:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=266s v=(0 0) 00010000:00010000:1.0:1787430805.136368:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430805.136379:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 6 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.136400:0:11754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 6 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.136433:0:11754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360eea00, rc 0) 00000100:00100000:1.0:1787430805.136513:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836210304:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 243us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.136521:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:3.0:1787430805.140343:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430805.140482:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836210560 00000100:00100000:0.0:1787430805.140508:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836210560 00000100:00100000:0.0:1787430805.140572:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:0.0:1787430805.140583:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11277:x1874256836210560:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787430805.140724:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11277:x1874256836210560:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 143us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430805.140733:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:0.0:1787430805.145877:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.146449:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836210688 00000100:00100000:3.0:1787430805.146460:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836210688 00000100:00100000:3.0:1787430805.146525:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1787430805.146536:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:11277:x1874256836210688:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430805.146556:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430805.146573:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913893f expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.146671:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 7 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.146681:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430805.146685:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430805.146691:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.146725:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 7 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.146739:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 7 pid: 11754 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.146753:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c1157b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1874256847804416:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430805.147744:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430805.185936:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.186171:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c1157b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1874256847804416:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430805.186208:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.186235:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491600, rc 0) 00000100:00100000:3.0:1787430805.186299:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11277:x1874256836210688:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 39764us (40433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.186309:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:1.0:1787430805.188147:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836210816 00000100:00100000:1.0:1787430805.188170:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836210816 00010000:00010000:1.0:1787430805.188214:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 7 pid: 11754 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430805.188255:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:1.0:1787430805.188266:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836210816:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430805.188281:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430805.188304:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 7 pid: 11754 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.188317:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 7 pid: 11754 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.188340:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a945dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138938 expref: 7 pid: 11754 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.188356:0:10313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430805.188360:0:10313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430805.188368:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.188378:0:10313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.188453:0:10313:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430805.188469:0:10313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10313:1874256847804544:192.168.202.25@tcp:105: 00000100:00100000:1.0:1787430805.188759:0:10313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430805.198473:0:10313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10313:1874256847804544:192.168.202.25@tcp:105: 00010000:00010000:1.0:1787430805.198500:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430805.198584:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836210816:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 10319us (12658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.198595:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:1.0:1787430805.201751:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430805.201840:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836210944 00000100:00100000:0.0:1787430805.201859:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836210944 00002000:00100000:0.0:1787430805.201913:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8e2b03ae2d80 x1874256836210944/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:26/0 lens 504/0 e 0 to 0 dl 1787430816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430805.201926:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b03ae2d80 with x1874256836210944 ext(0->8) 00002000:00010000:0.0:1787430805.201932:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b03ae2d80 00000100:00100000:0.0:1787430805.201967:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:0.0:1787430805.201978:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836210944:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787430805.204268:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836210944:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 2283us (2519us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787430805.204281:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00002000:00100000:0.0:1787430805.204293:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8e2b03ae2d80 x1874256836210944/t4294967303(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:26/0 lens 504/448 e 0 to 0 dl 1787430816 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430805.204303:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b03ae2d80 with x1874256836210944 ext(0->8) 00002000:00010000:0.0:1787430805.204309:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b03ae2d80 00000100:00100000:3.0:1787430805.232475:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.232575:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836211072 00000100:00100000:2.0:1787430805.232594:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836211072 00000100:00100000:2.0:1787430805.232684:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:2.0:1787430805.232694:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11277:x1874256836211072:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787430805.236634:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1787430805.236648:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787430805.236685:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1787430805.236705:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787430805.236713:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787430805.236829:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:11277:x1874256836211072:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 4132us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.236849:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:3.0:1787430805.237108:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847804672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787430805.237153:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430805.237227:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847804672 00000100:00100000:3.0:1787430805.237234:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847804672 00000100:00100000:3.0:1787430805.237274:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787430805.237281:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847804672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787430805.237419:0:8830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787430805.237430:0:8830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787430805 00002000:00010000:3.0:1787430805.237433:0:8830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787430805.237435:0:8830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787430805 -> 1787430805 00002000:00010000:3.0:1787430805.237438:0:8830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787430805.237470:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3630:x1874256847804672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (316us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787430805.237477:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787430805.237494:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787430805.237520:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2c11579c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787430805.237536:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847804672:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787430805.237892:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237905:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237914:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237921:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430805.237927:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237934:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237951:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430805.237954:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430805.237958:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237965:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94470 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237980:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.237985:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238011:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238016:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f1d600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430805.238019:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238025:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238033:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:2.0:1787430805.238036:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430805.238038:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238043:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d600/0x4dbb683ba6a944b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238054:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238061:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238067:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238072:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430805.238074:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238089:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238098:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:2.0:1787430805.238100:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430805.238102:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.238108:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a945b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430805.242320:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.242440:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836211200 00000100:00100000:3.0:1787430805.242451:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836211200 00000100:00100000:3.0:1787430805.242511:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:3.0:1787430805.242544:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836211200:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787430805.246386:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787430805.246399:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787430805.246594:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836211200:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 4048us (4296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.246634:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:1.0:1787430805.260242:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.260381:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836211456 00000100:00100000:3.0:1787430805.260391:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836211456 00000100:00100000:3.0:1787430805.260468:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:3.0:1787430805.260478:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:11277:x1874256836211456:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787430805.260533:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430805.260560:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a945d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138931 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.260582:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430805.260587:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430805.260648:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.260662:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.260673:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430805.260789:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf95073c reply state 000000006393c964 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.260815:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.260821:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430805.260824:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430805.260827:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430805.260930:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:11277:x1874256836211456:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 453us (699us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787430805.260938:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:1.0:1787430805.263508:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.263705:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836211584 00000100:00100000:3.0:1787430805.263714:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836211584 00000100:00100000:3.0:1787430805.263756:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:3.0:1787430805.263765:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836211584:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787430805.263996:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787430805.264062:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787430805 -> 1787430804 00002000:00010000:3.0:1787430805.264065:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787430801 00002000:00010000:3.0:1787430805.264067:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787430805 -> 1787430804 00002000:00010000:3.0:1787430805.264069:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787430805.264154:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836211584:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 389us (653us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787430805.264170:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:2.0:1787430805.276879:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.276957:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836211840 00000100:00100000:3.0:1787430805.276969:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836211840 00000100:00100000:3.0:1787430805.277040:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:3.0:1787430805.277052:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:11277:x1874256836211840:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787430805.277124:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.277167:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 15 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.277177:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.277211:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 15 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.277224:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 15 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.277239:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847804800:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430805.277321:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430805.283264:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430805.283392:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836211968 00000100:00100000:2.0:1787430805.283402:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836211968 00010000:00010000:2.0:1787430805.283456:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 16 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430805.283530:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:2.0:1787430805.283542:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:2400:x1874256836211968:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430805.283559:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430805.283567:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 16 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.283591:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 16 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.283658:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:2.0:1787430805.283663:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.283672:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.283680:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.283699:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430805.283801:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:2400:x1874256836211968:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 260us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.283820:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00010000:00010000:3.0:1787430805.284582:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a945b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138923 expref: 15 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.284614:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847804800:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430805.284634:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284643:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284650:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284684:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284700:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284707:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284714:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430805.284718:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284726:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284737:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430805.284740:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787430805.284743:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.284748:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a945f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.284794:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:11277:x1874256836211840:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 7744us (7924us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787430805.284801:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:2.0:1787430805.294349:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.294464:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836212096 00000100:00100000:3.0:1787430805.294475:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836212096 00000100:00100000:3.0:1787430805.294546:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:3.0:1787430805.294559:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836212096:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787430805.294629:0:11754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.294664:0:11754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.294673:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430805.294677:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430805.294682:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.294716:0:11754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.294731:0:11754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 7 pid: 8408 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.294745:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11578000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11754:1874256847804928:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430805.294830:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430805.297673:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.297707:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836212224 00000100:00100000:3.0:1787430805.297715:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836212224 00010000:00010000:3.0:1787430805.297754:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 8 pid: 8408 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.297798:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:3.0:1787430805.297810:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836212224:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430805.297822:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430805.297872:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 8 pid: 8408 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.297887:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 8 pid: 8408 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.297912:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430805.297917:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430805.297923:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.297935:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.297956:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430805.298018:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836212224:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 210us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.298026:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00010000:00010000:2.0:1787430805.298367:0:11754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009c6fe22/0x4dbb683ba6a945e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913893f expref: 7 pid: 8408 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430805.298383:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11578000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11754:1874256847804928:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430805.298402:0:11754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298412:0:11754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298418:0:11754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298458:0:11754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298467:0:11754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298474:0:11754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298481:0:11754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430805.298485:0:11754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298493:0:11754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298506:0:11754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430805.298514:0:11754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a945f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430805.298572:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836212096:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 4015us (4234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.298580:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:3.0:1787430805.310203:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430805.310665:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836212480 00000100:00100000:0.0:1787430805.310676:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836212480 00000100:00100000:0.0:1787430805.310743:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 92 00000100:00100000:0.0:1787430805.310752:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:11277:x1874256836212480:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787430805.310823:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.310839:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 14 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.310849:0:8819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.310883:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 14 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.310898:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 14 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430805.310912:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847805056:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430805.310983:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12bbb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430805.316120:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847805056:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430805.316152:0:8819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430805.316364:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.316977:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836212608 00000100:00100000:3.0:1787430805.316986:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836212608 00010000:00010000:3.0:1787430805.317034:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 15 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.317101:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:3.0:1787430805.317113:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11441050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:2399:x1874256836212608:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430805.317129:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430805.317138:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 15 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.317151:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 15 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.317492:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9443f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91388c8 expref: 15 pid: 8819 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.317510:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430805.317516:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.317531:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.317538:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.317571:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430805.317652:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11441050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:2399:x1874256836212608:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 540us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.317660:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00010000:00010000:0.0:1787430805.318019:0:8819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.318028:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.318241:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.318255:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 14 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.318271:0:8819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.318301:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 14 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430805.318315:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 14 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430805.318329:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847805184:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430805.318383:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12bbb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430805.340206:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430805.340305:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836212736 00000100:00100000:1.0:1787430805.340314:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836212736 00010000:00010000:1.0:1787430805.340357:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 15 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430805.340404:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:1.0:1787430805.340415:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:2399:x1874256836212736:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430805.340440:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430805.340448:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 15 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.340464:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 15 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.340488:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:1.0:1787430805.340493:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.340502:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.340509:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.340526:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430805.340575:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:2399:x1874256836212736:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 162us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.340582:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00010000:00010000:3.0:1787430805.340821:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a945c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913892a expref: 14 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.340851:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847805184:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430805.340872:0:8819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.340881:0:8819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.340887:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430805.340987:0:8819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787430805.341099:0:8819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787430805.341135:0:8819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787430805.341224:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8819:1874256847805312:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787430805.341268:0:8819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430805.341299:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35000 going to sleep for 11 seconds 00000100:00100000:3.0:1787430805.341315:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847805312 00000100:00100000:3.0:1787430805.341319:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847805312 00000100:00100000:3.0:1787430805.341347:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787430805.341354:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8819:x1874256847805312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787430805.341416:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8819:x1874256847805312:12345-0@lo:1000:mdt00_003.0 Request processed in 63us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.341434:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787430805.341464:0:8819:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787430805.341470:0:8819:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2c11579c00, transno 4294967304 00000100:00100000:3.0:1787430805.341480:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8819:1874256847805312:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787430805.341584:0:8819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1787430805.341652:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8819:1874256847805440:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787430805.341678:0:8819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430805.341696:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35240 going to sleep for 11 seconds 00000100:00100000:3.0:1787430805.341770:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847805440 00000100:00100000:3.0:1787430805.341774:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847805440 00000100:00100000:3.0:1787430805.341798:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787430805.341805:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8819:x1874256847805440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787430805.341890:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8819:x1874256847805440:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (211us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787430805.341897:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787430805.341929:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8819:1874256847805440:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787430805.341955:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.341964:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.341971:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.341977:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430805.341982:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.341990:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.342004:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:3.0:1787430805.342007:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430805.342018:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.342024:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94606 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.342965:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.342973:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.342979:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.342983:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430805.342987:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.342992:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.344223:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430805.344229:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430805.344234:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.344242:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9453b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.344268:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.344282:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 17 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.344300:0:8819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.344334:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 17 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.344348:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 17 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.344361:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847805568:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430805.344442:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c11066b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430805.350476:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847805568:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430805.350537:0:8819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430805.350693:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430805.351201:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836212864 00000100:00100000:3.0:1787430805.351209:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836212864 00010000:00010000:3.0:1787430805.351247:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 18 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430805.351283:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1787430805.351294:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2400:x1874256836212864:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430805.351309:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430805.351316:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 18 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.351347:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 18 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.351369:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94557 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913890e expref: 18 pid: 10098 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.351387:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430805.351392:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.351402:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.351409:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430805.351449:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430805.351507:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:2400:x1874256836212864:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 213us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.351515:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00010000:00010000:1.0:1787430805.351821:0:8819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351848:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351860:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351867:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351873:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351879:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430805.351883:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351890:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351899:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:1.0:1787430805.351902:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430805.351905:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351911:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9460d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351922:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351927:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351938:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351943:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430805.351946:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351951:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351958:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:1.0:1787430805.351961:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787430805.351963:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.351968:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a945ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430805.352118:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11277:x1874256836212480:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 41366us (41924us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787430805.352127:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 92 00000020:00080000:1.0:1787430805.352131:0:8819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787430805.353393:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430805.353400:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430805.353429:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787430805.353436:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430805.375034:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430805.375127:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836213120 00000100:00100000:1.0:1787430805.375139:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836213120 00000100:00100000:1.0:1787430805.375390:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:1.0:1787430805.375401:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11277:x1874256836213120:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787430805.375709:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787430805.375748:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1787430805.375803:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.375820:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.375832:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.375841:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.375848:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.375854:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.375873:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787430805.375956:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:11277:x1874256836213120:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 556us (933us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787430805.375964:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000020:00080000:1.0:1787430805.375969:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787430805.375992:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430805.375998:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.376004:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430805.376008:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.376015:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.376034:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:1.0:1787430805.376037:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787430805.376042:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.376048:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94614 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430805.376060:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430805.376061:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430805.376063:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430805.503728:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430805.759806:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847805696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430805.759873:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.759944:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847805696 00000100:00100000:1.0:1787430805.759951:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847805696 00000100:00100000:1.0:1787430805.760007:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787430805.760017:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847805696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430805.760045:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430805.760086:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847805696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.760093:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787430805.760111:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430805.760146:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847805696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430805.760229:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430805.760238:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847805824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430805.760267:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430805.760298:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847805824 00000100:00100000:2.0:1787430805.760310:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847805824 00000100:00100000:2.0:1787430805.760346:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787430805.760354:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847805824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787430805.760382:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787430805.760415:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847805824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.760434:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787430805.760468:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847805824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430805.761395:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847805952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430805.761445:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430805.761488:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847805952 00000100:00100000:3.0:1787430805.761499:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847805952 00000100:00100000:3.0:1787430805.761536:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787430805.761543:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847805952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430805.761556:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430805.761586:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847805952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.761592:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787430805.761761:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847805952:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787430805.761850:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430805.767739:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847806080:0@lo:400:kworker.0 00000100:00100000:3.0:1787430805.767804:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430805.767836:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847806592:0@lo:400:kworker.0 00000100:00100000:3.0:1787430805.767861:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430805.767879:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847807104:0@lo:400:kworker.0 00000100:00100000:3.0:1787430805.767899:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430805.767935:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806592 00000100:00100000:3.0:1787430805.767942:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806592 00000100:00100000:3.0:1787430805.767990:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847807104 00000100:00100000:3.0:1787430805.767994:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847807104 00000100:00100000:3.0:1787430805.768015:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787430805.768022:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847806592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430805.768067:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847806592:12345-0@lo:400:kworker.0 Request processed in 44us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.768073:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787430805.768088:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787430805.768094:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847807104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430805.768124:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847807104:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430805.768130:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1787430805.768150:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430805.768174:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847806592:0@lo:400:kworker.0 00000100:00100000:3.0:1787430805.768183:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847807104:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768437:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847806464:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768467:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.768495:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847806976:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768532:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.768565:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806080 00000100:00100000:1.0:1787430805.768569:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806080 00000100:00100000:1.0:1787430805.768595:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787430805.768711:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847806080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768748:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847806080:12345-0@lo:400:kworker.0 Request processed in 146us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.768754:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787430805.768781:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806976 00000100:00100000:1.0:1787430805.768785:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806976 00000100:00100000:1.0:1787430805.768810:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787430805.768817:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847806976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768848:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847806976:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.768853:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787430805.768874:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847806336:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768900:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.768920:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847806848:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768940:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.768960:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787430805.768966:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847806208:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.768987:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.769003:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847806720:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.769021:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.769035:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847807232:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.769066:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430805.769093:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806336 00000100:00100000:1.0:1787430805.769097:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806336 00000100:00100000:1.0:1787430805.769120:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787430805.769127:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847806336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.769164:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847806336:12345-0@lo:400:kworker.0 Request processed in 37us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.769170:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787430805.769186:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806848 00000100:00100000:1.0:1787430805.769190:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806848 00000100:00100000:1.0:1787430805.769219:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787430805.769226:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847806848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.769255:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847806848:12345-0@lo:400:kworker.0 Request processed in 30us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.769262:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787430805.769278:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806464 00000100:00100000:1.0:1787430805.769281:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806464 00000100:00100000:1.0:1787430805.769302:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806208 00000100:00100000:1.0:1787430805.769305:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806208 00000100:00100000:1.0:1787430805.769319:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847806720 00000100:00100000:1.0:1787430805.769322:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847806720 00000100:00100000:1.0:1787430805.769334:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847807232 00000100:00100000:1.0:1787430805.769337:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847807232 00000100:00100000:1.0:1787430805.769353:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787430805.769359:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847806464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.769388:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847806464:12345-0@lo:400:kworker.0 Request processed in 29us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430805.769394:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787430805.769414:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787430805.770104:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847806208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.770143:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847806208:12345-0@lo:400:kworker.0 Request processed in 48us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.775889:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787430805.775914:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847806720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430805.776010:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847806720:12345-0@lo:400:kworker.0 Request processed in 108us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.776018:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787430805.776056:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787430805.776064:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847807232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430805.776097:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847807232:12345-0@lo:400:kworker.0 Request processed in 34us (7030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430805.776103:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787430805.781133:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847806464:0@lo:400:kworker.0 00000100:00100000:0.0:1787430805.781153:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847806976:0@lo:400:kworker.0 00000100:00100000:0.0:1787430805.781196:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847806080:0@lo:400:kworker.0 00000100:00080000:0.0:1787430805.781218:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430805.781223:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430805.781239:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847806208:0@lo:400:kworker.0 00010000:00080000:0.0:1787430805.781254:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf1880 x1874256847806720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430805.781266:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847806720:0@lo:400:kworker.0 00010000:00080000:0.0:1787430805.781277:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03cf0700 x1874256847807232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430805.781292:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847807232:0@lo:400:kworker.0 00000100:00100000:0.0:1787430805.781305:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847806336:0@lo:400:kworker.0 00000100:00100000:0.0:1787430805.781316:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847806848:0@lo:400:kworker.0 00000100:00100000:1.0:1787430805.784154:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000040:00080000:0.0:1787430805.879368:0:14181:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430805.879377:0:14181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430805.879571:0:14181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787430805.879581:0:14181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787430806.000399:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.000565:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836213376 00000100:00100000:1.0:1787430806.000575:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836213376 00000100:00100000:1.0:1787430806.000657:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 93 00000100:00100000:1.0:1787430806.000668:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:11291:x1874256836213376:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430806.000693:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430806.000713:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a9461b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138946 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.001309:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94622 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.001337:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.001364:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430806.001407:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787430806.002193:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a9461b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138946 expref: 21 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.002210:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94622 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138946 expref: 20 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.002271:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:1.0:1787430806.002294:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430806.002298:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef000, rc 0) 00000100:00100000:1.0:1787430806.002422:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:11291:x1874256836213376:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1747us (2024us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787430806.002431:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 93 00000100:00100000:2.0:1787430806.016575:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.018362:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836213504 00000100:00100000:0.0:1787430806.018374:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836213504 00000100:00100000:0.0:1787430806.018843:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00100000:0.0:1787430806.018857:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:11291:x1874256836213504:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:0.0:1787430806.018928:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.018946:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.018957:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.018972:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.018979:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.018986:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019070:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019079:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019086:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430806.019129:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019141:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019147:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019155:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019161:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430806.019166:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019173:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019184:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430806.019187:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430806.019191:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019204:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019217:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019223:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019229:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019234:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430806.019237:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019242:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019250:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33900) 00010000:00010000:0.0:1787430806.019252:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430806.019254:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019260:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019273:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019280:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019291:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019296:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430806.019299:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019305:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019313:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b03b33400) 00010000:00010000:0.0:1787430806.019315:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430806.019317:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.019322:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a9463e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.019526:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:11291:x1874256836213504:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 672us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430806.019535:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00080000:1.0:1787430806.021704:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430806.040954:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.041099:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836213760 00000100:00100000:1.0:1787430806.041129:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836213760 00000100:00100000:1.0:1787430806.041208:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:1.0:1787430806.041228:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:11294:x1874256836213760:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430806.041258:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430806.041285:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94645 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913894d expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041467:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041481:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041523:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041554:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041563:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041584:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041817:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041826:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.041833:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430806.041843:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787430806.042068:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042076:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042083:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042089:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eea00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.042093:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042112:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042124:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:1.0:1787430806.042140:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430806.042151:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042172:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a9464c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042202:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042221:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042244:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042249:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.042271:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042289:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042336:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b0353f100) 00010000:00010000:1.0:1787430806.042339:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430806.042341:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042363:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042445:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94645 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 23 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042550:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 22 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.042559:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:1.0:1787430806.042562:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430806.042564:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031800, rc 0) 00000100:00100000:1.0:1787430806.042785:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11294:x1874256836213760:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1556us (1829us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787430806.042803:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:3.0:1787430806.044975:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.045051:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836213888 00000100:00100000:0.0:1787430806.045058:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836213888 00000100:00100000:0.0:1787430806.045108:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:0.0:1787430806.045118:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11294:x1874256836213888:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:0.0:1787430806.045168:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045182:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045205:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045233:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045240:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045246:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045251:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430806.045254:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045260:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045270:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:0.0:1787430806.045273:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430806.045276:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.045282:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.045338:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11294:x1874256836213888:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 221us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430806.045346:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:2.0:1787430806.046577:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.046693:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836214144 00000100:00100000:1.0:1787430806.046700:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836214144 00000100:00100000:1.0:1787430806.046734:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:1.0:1787430806.046742:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11294:x1874256836214144:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1787430806.046899:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:11294:x1874256836214144:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 157us (324us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1787430806.046906:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1787430806.062670:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.062770:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836214400 00000100:00100000:2.0:1787430806.062796:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836214400 00000100:00100000:2.0:1787430806.062858:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:2.0:1787430806.062869:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:10821:x1874256836214400:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430806.062894:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430806.062914:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9466f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138954 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.063037:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.063052:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 24 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.063061:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.063092:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 24 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.063104:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 24 pid: 8819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430806.063117:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847807360:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430806.063201:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430806.066218:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.066282:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836214528 00000100:00100000:1.0:1787430806.066289:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836214528 00010000:00010000:1.0:1787430806.066325:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 25 pid: 8819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430806.066362:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:1.0:1787430806.066371:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:2399:x1874256836214528:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430806.066382:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430806.066411:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 25 pid: 8819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.066433:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 25 pid: 8819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.066456:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:1.0:1787430806.066461:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.066471:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.066478:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.066498:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430806.066656:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9465a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913894d expref: 25 pid: 8819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.066679:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847807360:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430806.066699:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.066707:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.066712:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430806.066729:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787430806.066858:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a9466f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 26 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.066872:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 25 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.066879:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:0.0:1787430806.066882:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787430806.066885:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03000, rc 0) 00000100:00100000:0.0:1787430806.067079:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:10821:x1874256836214400:12345-192.168.202.25@tcp:101:bash.0 Request processed in 4211us (4419us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787430806.067086:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:1.0:1787430806.067857:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:2399:x1874256836214528:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 1485us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430806.067867:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:1.0:1787430806.070712:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.070828:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836214656 00000100:00100000:2.0:1787430806.070987:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836214656 00000100:00100000:2.0:1787430806.071159:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 98 00000100:00100000:2.0:1787430806.071171:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:10821:x1874256836214656:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430806.071270:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430806.071290:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94684 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913895b expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.071324:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9468b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.071338:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9468b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.071349:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9468b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.071482:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94684 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913895b expref: 26 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.071499:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9468b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913895b expref: 25 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.071816:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:2.0:1787430806.071820:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430806.071823:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02600, rc 0) 00000100:00100000:2.0:1787430806.071896:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:10821:x1874256836214656:12345-192.168.202.25@tcp:101:bash.0 Request processed in 727us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430806.071904:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 98 00000100:00100000:1.0:1787430806.075170:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.075250:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836214912 00000100:00100000:0.0:1787430806.075260:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836214912 00000100:00100000:0.0:1787430806.075317:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 99 00000100:00100000:0.0:1787430806.075329:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:10821:x1874256836214912:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:0.0:1787430806.075579:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.075625:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.075637:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430806.075682:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1787430806.075705:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008341f470 reply state 000000007224d1ca transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.075718:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.075725:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:0.0:1787430806.075728:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430806.075731:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787430806.075769:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1787430806.076097:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:10821:x1874256836214912:12345-192.168.202.25@tcp:36:bash.0 Request processed in 769us (935us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787430806.076105:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 99 00000020:00080000:0.0:1787430806.076111:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787430806.078120:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.078261:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836215040 00000100:00100000:0.0:1787430806.078281:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836215040 00000100:00100000:0.0:1787430806.078583:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 100 00000100:00100000:0.0:1787430806.078595:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:10821:x1874256836215040:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430806.078650:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430806.078668:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94699 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138962 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.078729:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138962 expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.078743:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138962 expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.078761:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:0.0:1787430806.078764:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430806.078767:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174c00, rc 0) 00000100:00100000:0.0:1787430806.078815:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:10821:x1874256836215040:12345-192.168.202.25@tcp:101:bash.0 Request processed in 223us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430806.078822:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 100 00000100:00100000:1.0:1787430806.082270:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.082518:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836215168 00000100:00100000:3.0:1787430806.082530:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836215168 00000100:00100000:3.0:1787430806.082794:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:3.0:1787430806.082870:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:10821:x1874256836215168:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1787430806.082903:0:11754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430806.082924:0:11754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138969 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430806.082950:0:11754:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a0794, atime: 0x6a8a0791, ctime: 0x6a8a0794, blocks: 0x8 00010000:00010000:3.0:1787430806.082973:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=267s v=(0 0) 00010000:00010000:3.0:1787430806.082977:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430806.082986:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 7 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.083004:0:11754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 7 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.083030:0:11754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a200, rc 0) 00000100:00100000:3.0:1787430806.083084:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:10821:x1874256836215168:12345-192.168.202.25@tcp:101:bash.0 Request processed in 280us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.083091:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:1.0:1787430806.085023:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.085100:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836215296 00000100:00100000:3.0:1787430806.085109:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836215296 00002000:00010000:3.0:1787430806.085144:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1787430806.085149:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2c3a639c00 with x1874256836215296 ext(0->18446744073709551615) 00002000:00010000:3.0:1787430806.085159:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2c3a639c00. 00000100:00100000:3.0:1787430806.085191:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:3.0:1787430806.085201:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836215296:12345-192.168.202.25@tcp:10:bash.0 00002000:00010000:3.0:1787430806.085477:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787430806.085481:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787430804 -> 1787430806 00002000:00010000:3.0:1787430806.085483:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787430801 -> 1787430801 00002000:00010000:3.0:1787430806.085485:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787430804 -> 1787430806 00002000:00010000:3.0:1787430806.085487:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787430806.085544:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2401:x1874256836215296:12345-192.168.202.25@tcp:10:bash.0 Request processed in 344us (528us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787430806.085552:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00002000:00010000:3.0:1787430806.085555:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1787430806.085557:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2c3a639c00 with x1874256836215296 ext(0->18446744073709551615) 00002000:00010000:3.0:1787430806.085562:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2c3a639c00. 00000100:00100000:3.0:1787430806.130142:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.130304:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836215424 00000100:00100000:1.0:1787430806.130315:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836215424 00000100:00100000:1.0:1787430806.130488:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:1.0:1787430806.130500:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11308:x1874256836215424:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:1.0:1787430806.130750:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130768:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130780:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130795:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130802:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130808:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130885:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130894:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130901:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430806.130946:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130957:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130974:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130980:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130985:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.130989:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.130997:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131009:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:1.0:1787430806.131012:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430806.131017:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131024:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131037:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131043:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131049:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131055:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.131064:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131083:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131092:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b0353f100) 00010000:00010000:1.0:1787430806.131095:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430806.131098:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131103:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131118:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131124:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131130:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131134:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.131137:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131143:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131150:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:1.0:1787430806.131152:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430806.131161:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.131167:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430806.131332:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11308:x1874256836215424:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 833us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430806.131339:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:3.0:1787430806.155349:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.155470:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836215680 00000100:00100000:1.0:1787430806.155480:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836215680 00000100:00100000:1.0:1787430806.155542:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:1.0:1787430806.155553:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11311:x1874256836215680:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430806.155692:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430806.155713:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138970 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.155782:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.155796:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.155806:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.155819:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.155826:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156410:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156527:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a946d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156538:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a946d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156546:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a946d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430806.156636:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787430806.156716:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156724:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156730:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156736:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.156741:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156748:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156760:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:1.0:1787430806.156763:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430806.156774:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156781:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a946c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156796:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156803:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156809:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156813:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.156816:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156822:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156927:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b0353f100) 00010000:00010000:1.0:1787430806.156930:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430806.156934:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156940:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a946ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.156981:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a946bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138970 expref: 33 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.157007:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a946d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138970 expref: 32 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.157015:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:1.0:1787430806.157017:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787430806.157019:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031400, rc 0) 00000100:00100000:1.0:1787430806.157444:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11311:x1874256836215680:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1891us (2100us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787430806.157452:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:3.0:1787430806.159847:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.159961:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836215808 00000100:00100000:2.0:1787430806.159969:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836215808 00000100:00100000:2.0:1787430806.160047:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:2.0:1787430806.160055:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11311:x1874256836215808:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:2.0:1787430806.160115:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.160127:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 32 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.160133:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.160159:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 32 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.160169:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 32 pid: 10098 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430806.160178:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847807488:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430806.160246:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430806.163366:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.163456:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836216064 00000100:00100000:1.0:1787430806.163464:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836216064 00000100:00100000:1.0:1787430806.163519:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:1.0:1787430806.163531:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:6159:x1874256836216064:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787430806.163819:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:6159:x1874256836216064:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 290us (459us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787430806.163827:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1787430806.163955:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847807488:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430806.163979:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430806.165395:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.166382:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836216192 00000100:00100000:0.0:1787430806.166389:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836216192 00010000:00010000:0.0:1787430806.166437:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 34 pid: 10098 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.166500:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:0.0:1787430806.166507:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:2400:x1874256836216192:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430806.166519:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430806.166525:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 34 pid: 10098 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.166538:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 34 pid: 10098 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.166888:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94676 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138954 expref: 34 pid: 10098 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.166904:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:0.0:1787430806.166908:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.166918:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.166926:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.166953:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430806.167353:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167359:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167388:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167403:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167410:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167426:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430806.167430:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167438:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167448:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:2.0:1787430806.167451:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430806.167454:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.167460:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.167628:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:2400:x1874256836216192:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 1120us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430806.167634:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:2.0:1787430806.167762:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11311:x1874256836215808:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 7707us (7935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430806.167771:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:3.0:1787430806.169759:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.170048:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836216448 00000100:00100000:0.0:1787430806.170057:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836216448 00000100:00100000:0.0:1787430806.170109:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1787430806.170120:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:11311:x1874256836216448:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430806.170350:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:11311:x1874256836216448:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 232us (598us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787430806.170358:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:1.0:1787430806.239746:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.239921:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836216704 00000100:00100000:2.0:1787430806.239932:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836216704 00000100:00100000:2.0:1787430806.240031:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:2.0:1787430806.240044:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+33:11322:x1874256836216704:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:2.0:1787430806.240069:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430806.240101:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138977 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240174:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240190:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240202:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240218:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240225:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240232:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240343:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a946fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240353:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a946fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240360:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a946fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430806.240370:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787430806.240466:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240485:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240492:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240498:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430806.240503:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240511:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240595:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430806.240625:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430806.240630:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240637:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a946ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240651:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240658:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240663:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240669:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430806.240678:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240685:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240694:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b29a00) 00010000:00010000:2.0:1787430806.240697:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430806.240700:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240706:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a946f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240746:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a946e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138977 expref: 36 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240761:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a946fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138977 expref: 35 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.240769:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:2.0:1787430806.240771:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430806.240774:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02a00, rc 0) 00000100:00100000:2.0:1787430806.240893:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11322:x1874256836216704:12345-192.168.202.25@tcp:101:cat.0 Request processed in 851us (1157us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787430806.240901:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:3.0:1787430806.245138:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.245201:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836216960 00000100:00100000:0.0:1787430806.245211:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836216960 00000100:00100000:0.0:1787430806.245265:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1787430806.245287:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11322:x1874256836216960:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:0.0:1787430806.246197:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+36:11322:x1874256836216960:12345-192.168.202.25@tcp:35:cat.0 Request processed in 908us (1065us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787430806.246206:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1787430806.260214:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.260273:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836217216 00000100:00100000:0.0:1787430806.260284:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836217216 00000100:00100000:0.0:1787430806.260380:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:0.0:1787430806.260389:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+36:11323:x1874256836217216:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:0.0:1787430806.260462:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787430806.260488:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94699 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138962 expref: 36 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260507:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a946fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138977 expref: 35 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260516:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a946d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138970 expref: 34 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260541:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9468b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913895b expref: 33 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260550:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:0.0:1787430806.260555:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430806.260576:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260589:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260655:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260671:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260679:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260686:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260764:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260772:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.260778:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430806.260963:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787430806.260970:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 267733367971ns, next at 268733366244ns, rc = 0 00010000:00010000:0.0:1787430806.261003:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261009:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261014:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261030:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261037:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261043:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261070:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430806.261087:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261094:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261100:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261106:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430806.261111:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261119:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261128:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:0.0:1787430806.261131:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787430806.261134:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261149:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94717 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261166:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261172:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261178:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261184:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430806.261186:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261192:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261200:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430806.261202:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430806.261205:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261211:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94709 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430806.261220:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f0474c1 reply state 00000000cded72b5 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261231:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.261244:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33400) 00010000:00010000:0.0:1787430806.261246:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430806.261248:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430806.261322:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11323:x1874256836217216:12345-192.168.202.25@tcp:36:rm.0 Request processed in 934us (1116us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787430806.261328:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 105 00010000:00010000:3.0:1787430806.261529:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430806.261535:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.261542:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430806.261545:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.261552:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.261560:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:3.0:1787430806.261563:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787430806.261565:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.261570:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9471e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.261581:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430806.261583:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430806.261584:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787430806.277939:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787430806.277958:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1787430806.304667:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.304854:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836217472 00000100:00100000:0.0:1787430806.304865:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836217472 00000100:00100000:0.0:1787430806.304926:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:0.0:1787430806.304938:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11329:x1874256836217472:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430806.304967:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430806.304994:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94725 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913897e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305115:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305131:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305142:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305153:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305160:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305182:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787430806.305510:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787430806.305695:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305704:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305710:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305743:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305750:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305757:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305762:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430806.305766:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305773:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305783:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430806.305785:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430806.305795:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305801:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a9472c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430806.305817:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fca7f2d0 reply state 000000001d19146e transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305827:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305833:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33400) 00010000:00010000:0.0:1787430806.305836:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430806.305839:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787430806.305863:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94725 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 37 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305878:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 36 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.305884:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2b03b34500) 00010000:00010000:0.0:1787430806.305886:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430806.305888:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175200, rc 0) 00000100:00100000:0.0:1787430806.305959:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:11329:x1874256836217472:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1023us (1301us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787430806.305967:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:1.0:1787430806.309182:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.309271:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836217600 00000100:00100000:2.0:1787430806.309280:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836217600 00000100:00100000:2.0:1787430806.309337:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:2.0:1787430806.309360:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836217600:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430806.309378:0:8830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430806.309404:0:8830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138985 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430806.309441:0:8830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430806.309459:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=267s v=(0 0) 00010000:00010000:2.0:1787430806.309464:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430806.309474:0:8830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 6 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.309494:0:8830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 6 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.309509:0:8830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02200, rc 0) 00000100:00100000:2.0:1787430806.309584:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836217600:12345-192.168.202.25@tcp:101:bash.0 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430806.309592:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00080000:1.0:1787430806.310121:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430806.312442:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.312527:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836217728 00000100:00100000:2.0:1787430806.312538:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836217728 00000100:00100000:2.0:1787430806.312592:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:2.0:1787430806.312620:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:11329:x1874256836217728:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430806.312635:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430806.312655:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913898c expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.312707:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 7 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.312716:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430806.312720:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430806.312726:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.312759:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 7 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.312773:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 7 pid: 8830 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430806.312787:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847807616:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430806.312886:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430806.316208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.316386:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836217856 00000100:00100000:0.0:1787430806.316402:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836217856 00010000:00010000:0.0:1787430806.316452:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 8 pid: 8830 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.316506:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:0.0:1787430806.316516:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836217856:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430806.316530:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430806.316551:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 8 pid: 8830 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.316566:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 8 pid: 8830 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.316589:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430806.316594:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430806.316635:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.316646:0:9495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.316678:0:9495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.316693:0:9495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9495:1874256847807744:192.168.202.25@tcp:105: 00000100:00100000:0.0:1787430806.316762:0:9495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787430806.318508:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a94748 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138985 expref: 8 pid: 8830 timeout: 367 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430806.318539:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847807616:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430806.318567:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.318579:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03200, rc 0) 00000100:00100000:2.0:1787430806.318666:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11329:x1874256836217728:12345-192.168.202.25@tcp:101:bash.0 Request processed in 6065us (6231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430806.318674:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:2.0:1787430806.319762:0:9495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9495:1874256847807744:192.168.202.25@tcp:105: 00010000:00010000:2.0:1787430806.319784:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430806.319826:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836217856:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 3310us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430806.319844:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:3.0:1787430806.322117:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.322196:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836218112 00000100:00100000:2.0:1787430806.322206:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836218112 00000100:00100000:2.0:1787430806.322255:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:2.0:1787430806.322264:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:11329:x1874256836218112:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:2.0:1787430806.322567:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:11329:x1874256836218112:12345-192.168.202.25@tcp:35:bash.0 Request processed in 303us (456us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787430806.322575:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00010000:00010000:3.0:1787430806.527982:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430806.566701:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.566844:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836218240 00000100:00100000:3.0:1787430806.566854:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836218240 00000100:00100000:3.0:1787430806.566915:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 107 00000100:00100000:3.0:1787430806.566926:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:11345:x1874256836218240:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430806.566951:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430806.566970:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138993 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.567025:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a9475d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.567037:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a9475d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.567049:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a9475d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430806.567091:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787430806.567094:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430806.567112:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a9475d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.567132:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138993 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.567148:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a9475d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138993 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.567155:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430806.567170:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430806.567174:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b800, rc 0) 00000100:00100000:3.0:1787430806.567240:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:11345:x1874256836218240:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 316us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.567246:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 107 00000100:00100000:3.0:1787430806.574740:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.582653:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836218496 00000100:00100000:1.0:1787430806.582668:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836218496 00000100:00100000:1.0:1787430806.582733:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 108 00000100:00100000:1.0:1787430806.582742:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:11345:x1874256836218496:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430806.582763:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430806.582795:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94764 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b913899a expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.582907:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9476b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.582921:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9476b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.582932:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9476b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430806.582942:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787430806.583046:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94764 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913899a expref: 42 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.583067:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9476b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913899a expref: 41 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.583076:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2b03b34500) 00010000:00010000:1.0:1787430806.583079:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430806.583082:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031800, rc 0) 00000100:00100000:1.0:1787430806.583675:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+41:11345:x1874256836218496:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 931us (8942us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787430806.583684:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 108 00000100:00100000:1.0:1787430806.588999:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.589101:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.589189:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836218624 00000100:00100000:3.0:1787430806.589199:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836218624 00000100:00100000:3.0:1787430806.589265:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:3.0:1787430806.589275:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+41:2400:x1874256836218624:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430806.589289:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430806.589312:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a9476b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913899a expref: 41 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.589332:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2b03b34500) 00010000:00010000:3.0:1787430806.589337:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430806.589382:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:2400:x1874256836218624:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 108us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.589389:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1787430806.590158:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836218880 00000100:00100000:2.0:1787430806.590165:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836218880 00000100:00100000:2.0:1787430806.590208:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 109 00000100:00100000:2.0:1787430806.590215:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:11345:x1874256836218880:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430806.590235:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430806.590249:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389a1 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.590336:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94780 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.590349:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.590372:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430806.590384:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787430806.590587:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389a1 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.590659:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94780 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389a1 expref: 42 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.590668:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2b03b34500) 00010000:00010000:2.0:1787430806.590671:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787430806.590674:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02c00, rc 0) 00000100:00100000:2.0:1787430806.590712:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:11345:x1874256836218880:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 498us (1611us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787430806.590719:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 109 00000100:00100000:1.0:1787430806.596095:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.596169:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836219008 00000100:00100000:3.0:1787430806.596178:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836219008 00000100:00100000:3.0:1787430806.596230:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:3.0:1787430806.596240:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836219008:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:3.0:1787430806.596287:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.596307:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.596327:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787430806.596332:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430806.596337:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.596369:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.596382:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 6 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430806.596518:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1874256847807872:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430806.596637:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497540 going to sleep for 11 seconds 00000100:00100000:3.0:1787430806.599362:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1874256847807872:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430806.599402:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430806.604426:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.604519:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836219136 00000100:00100000:0.0:1787430806.604533:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836219136 00002000:00100000:0.0:1787430806.604650:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8e2c3a63bb80 x1874256836219136/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:27/0 lens 504/0 e 0 to 0 dl 1787430817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430806.604663:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2c3a63bb80 with x1874256836219136 ext(0->8) 00010000:00010000:0.0:1787430806.604674:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 7 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.604692:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 7 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430806.604701:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2c3a63bb80 00000100:00100000:0.0:1787430806.604728:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:0.0:1787430806.604738:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836219136:12345-192.168.202.25@tcp:4:lfs.0 00000100:00100000:0.0:1787430806.606428:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2399:x1874256836219136:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 1673us (2004us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787430806.606440:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00002000:00100000:0.0:1787430806.606450:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8e2c3a63bb80 x1874256836219136/t4294967303(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:27/0 lens 504/448 e 0 to 0 dl 1787430817 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430806.606461:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2c3a63bb80 with x1874256836219136 ext(0->8) 00010000:00010000:0.0:1787430806.606469:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 9 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.606486:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 9 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430806.606493:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2c3a63bb80 00000100:00100000:2.0:1787430806.615541:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.615652:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836219264 00000100:00100000:0.0:1787430806.615662:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836219264 00010000:00010000:0.0:1787430806.615704:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 9 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.615736:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:0.0:1787430806.615745:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11442c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2400:x1874256836219264:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430806.615758:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787430806.615774:0:6481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787430806.615777:0:6481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787430806 00002000:00010000:0.0:1787430806.615780:0:6481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787430806 00002000:00010000:0.0:1787430806.615782:0:6481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787430806 00002000:00010000:0.0:1787430806.615784:0:6481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787430806.615790:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 9 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.615803:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 9 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.615825:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000130ada7a/0x4dbb683ba6a9474f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913898c expref: 9 pid: 8409 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.615853:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430806.615858:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430806.615864:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.615894:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.615922:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430806.616018:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616029:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616050:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616064:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616073:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616081:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430806.616086:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616096:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616109:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.616116:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a9478e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.618095:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11442c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836219264:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 2343us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430806.618107:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:3.0:1787430806.618337:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836219008:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 22096us (22249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.618347:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:2.0:1787430806.623852:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.623999:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836219520 00000100:00100000:1.0:1787430806.624023:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836219520 00000100:00100000:1.0:1787430806.624115:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:1.0:1787430806.624125:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e5b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:11345:x1874256836219520:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:1.0:1787430806.624188:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94780 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389a1 expref: 42 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430806.624367:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1787430806.624390:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787430806.625050:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1787430806.625090:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.625106:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 46 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.625116:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.625154:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 46 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.625168:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 46 pid: 6499 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430806.625185:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1874256847808000:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430806.625344:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430806.634145:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.634770:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836219648 00000100:00100000:0.0:1787430806.634783:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836219648 00010000:00010000:0.0:1787430806.634839:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 47 pid: 6499 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430806.634885:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:0.0:1787430806.634896:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+47:2400:x1874256836219648:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430806.634913:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430806.634920:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 47 pid: 6499 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.634936:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 47 pid: 6499 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.634959:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2b03b34500) 00010000:00010000:0.0:1787430806.634966:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.634976:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.635002:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430806.635025:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430806.635094:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+47:2400:x1874256836219648:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 199us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430806.635102:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00010000:00010000:2.0:1787430806.636375:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9473a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913897e expref: 46 pid: 6499 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430806.636503:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1874256847808000:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430806.636960:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.636974:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.637004:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430806.637115:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1787430806.637213:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787430806.637298:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847808128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787430806.637347:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430806.637402:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430806.637478:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847808128 00000100:00100000:3.0:1787430806.637485:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847808128 00000100:00100000:3.0:1787430806.637541:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787430806.637572:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1874256847808128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787430806.637700:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1874256847808128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 142us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.637708:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787430806.637926:0:6501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1787430806.637932:0:6501:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1787430806.637947:0:6501:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b03d9d180, transno 4294967302 00000100:00100000:2.0:1787430806.637967:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847808128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787430806.638065:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1787430806.638102:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847808256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787430806.638125:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430806.638145:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787430806.638158:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847808256 00000100:00100000:2.0:1787430806.638161:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847808256 00000100:00100000:2.0:1787430806.638181:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787430806.638187:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1874256847808256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787430806.638268:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6501:x1874256847808256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (141us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787430806.638275:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787430806.638301:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1874256847808256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787430806.638327:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1787430806.638361:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.638370:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.638378:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.638384:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430806.638388:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.638397:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.638429:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2b03b34500) 00010000:00010000:2.0:1787430806.638432:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787430806.638436:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430806.638443:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94795 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430806.638537:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787430806.638595:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787430806.638805:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268111202650ns, next at 269111200439ns, rc = 0 00000001:00080000:2.0:1787430806.638814:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1787430806.639012:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2b03b34500) 00010000:00010000:2.0:1787430806.639016:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787430806.639023:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94780 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389a1 expref: 50 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430806.639133:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e5b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+49:11345:x1874256836219520:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 15009us (15300us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787430806.639141:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000020:00080000:2.0:1787430806.639144:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787430806.644063:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.644130:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836219776 00000100:00100000:3.0:1787430806.644140:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836219776 00000100:00100000:3.0:1787430806.644192:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00100000:3.0:1787430806.644202:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+49:11345:x1874256836219776:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430806.644229:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430806.644253:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9479c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389a8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.644307:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9479c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389a8 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.644322:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9479c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389a8 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.644338:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430806.644341:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430806.644345:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a600, rc 0) 00000100:00100000:3.0:1787430806.644425:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+50:11345:x1874256836219776:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 224us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.644432:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00100000:2.0:1787430806.647762:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430806.647821:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836220032 00000100:00100000:0.0:1787430806.647838:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836220032 00000100:00100000:0.0:1787430806.647892:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1787430806.647903:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+50:11345:x1874256836220032:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430806.648128:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+51:11345:x1874256836220032:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 227us (375us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787430806.648136:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1787430806.787056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.787190:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836220160 00000100:00100000:3.0:1787430806.787200:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836220160 00000100:00100000:3.0:1787430806.787263:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 111 00000100:00100000:3.0:1787430806.787286:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+51:11355:x1874256836220160:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:3.0:1787430806.787360:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787377:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787391:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787423:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787430:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787436:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787510:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787519:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787526:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430806.787571:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.787590:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788255:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788264:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788270:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8aa00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430806.788275:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788283:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788297:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430806.788299:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430806.788304:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788309:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a947a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788322:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788327:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788333:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788337:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430806.788349:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788356:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788364:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33400) 00010000:00010000:3.0:1787430806.788368:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430806.788370:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788376:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788386:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788403:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788419:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788424:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430806.788426:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788432:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788440:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430806.788442:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430806.788452:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.788457:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430806.788856:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+51:11355:x1874256836220160:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 1569us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430806.788866:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 111 00000100:00100000:1.0:1787430806.912718:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430806.912803:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836220416 00000100:00100000:3.0:1787430806.912813:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836220416 00000100:00100000:3.0:1787430806.912878:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:3.0:1787430806.912889:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+51:11358:x1874256836220416:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430806.912908:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430806.912927:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a947b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389af expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.912991:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913004:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913014:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913024:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913031:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913036:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913143:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913151:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913158:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430806.913166:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787430806.913233:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913240:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913246:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913251:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430806.913254:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913260:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913271:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430806.913274:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430806.913277:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913291:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a947bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913304:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913310:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913315:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913319:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430806.913323:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913328:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913335:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33400) 00010000:00010000:3.0:1787430806.913337:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430806.913340:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913345:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a947c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913374:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a947b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389af expref: 54 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913397:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389af expref: 53 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430806.913405:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430806.913420:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430806.913422:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:3.0:1787430806.913484:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+53:11358:x1874256836220416:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 596us (777us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787430806.913492:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:3.0:1787430806.919395:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430806.919489:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836220544 00000100:00100000:1.0:1787430806.919512:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836220544 00000100:00100000:1.0:1787430806.919585:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:1.0:1787430806.919595:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+53:11358:x1874256836220544:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:1.0:1787430806.919698:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919715:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919726:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919759:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919766:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919773:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919780:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430806.919784:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919791:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919803:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430806.919805:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430806.919810:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430806.919837:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a947db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430806.919914:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+53:11358:x1874256836220544:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 320us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430806.919921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:0.0:1787430806.930670:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430806.930787:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836220800 00000100:00100000:2.0:1787430806.930796:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836220800 00000100:00100000:2.0:1787430806.930864:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:2.0:1787430806.930875:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+53:11358:x1874256836220800:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430806.931104:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:11358:x1874256836220800:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 231us (443us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787430806.931112:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1787430807.042649:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.042811:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836221056 00000100:00100000:0.0:1787430807.042821:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836221056 00000100:00100000:0.0:1787430807.042904:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:0.0:1787430807.042917:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:11368:x1874256836221056:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430807.042942:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430807.042945:0:13789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787430807.042982:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a9475d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138993 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.043001:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430807.043020:0:13789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430807.043033:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a947e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389b6 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.043124:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a947e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.043136:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a947e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.043150:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a947e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430807.043162:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787430807.043264:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a947e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389b6 expref: 56 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.043280:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a947e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389b6 expref: 55 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.043287:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:0.0:1787430807.043290:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430807.043297:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174800, rc 0) 00000100:00100000:0.0:1787430807.043545:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+55:11368:x1874256836221056:12345-192.168.202.25@tcp:101:bash.0 Request processed in 630us (943us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787430807.043552:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:3.0:1787430807.047256:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.047356:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.047439:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836221312 00000100:00100000:1.0:1787430807.047449:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836221312 00000100:00100000:1.0:1787430807.047509:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:1.0:1787430807.047808:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+55:2402:x1874256836221312:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430807.047828:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430807.047853:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a947e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389b6 expref: 55 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.047873:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430807.047877:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430807.047930:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:2402:x1874256836221312:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 412us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430807.047937:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:2.0:1787430807.049202:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836221184 00000100:00100000:2.0:1787430807.049211:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836221184 00000100:00100000:2.0:1787430807.049288:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:2.0:1787430807.049296:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:11368:x1874256836221184:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430807.049318:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.049332:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a947f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389bd expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.049362:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.049394:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.049414:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.049519:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a947f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 56 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.049545:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 55 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.049553:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.049556:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430807.049559:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02c00, rc 0) 00000100:00100000:2.0:1787430807.049751:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+55:11368:x1874256836221184:12345-192.168.202.25@tcp:101:bash.0 Request processed in 455us (2503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.049757:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:3.0:1787430807.052219:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.052287:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836221568 00000100:00100000:1.0:1787430807.052295:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836221568 00000100:00100000:1.0:1787430807.052358:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:1.0:1787430807.052367:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+55:11368:x1874256836221568:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:1.0:1787430807.052423:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430807.052448:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a947cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389af expref: 55 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.052478:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430807.052482:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430807.053501:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.053515:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.053690:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430807.053730:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787430807.053747:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000728e092c reply state 00000000bf2ddd75 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.053759:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.053765:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430807.053767:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787430807.053769:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430807.053891:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+57:11368:x1874256836221568:12345-192.168.202.25@tcp:36:bash.0 Request processed in 1524us (1676us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787430807.053899:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 116 00000020:00080000:1.0:1787430807.053905:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787430807.055681:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.056204:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836221696 00000100:00100000:2.0:1787430807.056211:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836221696 00000100:00100000:0.0:1787430807.056260:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 117 00000100:00100000:0.0:1787430807.056271:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+57:11368:x1874256836221696:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430807.056290:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430807.056314:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9480c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389c4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.056379:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.056390:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.056417:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430807.056443:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787430807.056447:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430807.056461:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.056487:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9480c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.056502:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.056510:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:0.0:1787430807.056513:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430807.056516:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175a00, rc 0) 00000100:00100000:0.0:1787430807.056569:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+58:11368:x1874256836221696:12345-192.168.202.25@tcp:101:bash.0 Request processed in 301us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430807.056575:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 117 00000100:00100000:0.0:1787430807.058874:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.058963:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836221952 00000100:00100000:3.0:1787430807.058972:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836221952 00000100:00100000:3.0:1787430807.059015:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:3.0:1787430807.059023:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+58:11368:x1874256836221952:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:3.0:1787430807.059202:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:11368:x1874256836221952:12345-192.168.202.25@tcp:35:bash.0 Request processed in 179us (334us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787430807.059208:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:3.0:1787430807.108244:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.108352:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836222080 00000100:00100000:2.0:1787430807.108362:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836222080 00000100:00100000:2.0:1787430807.108448:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:2.0:1787430807.108458:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:11374:x1874256836222080:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430807.108482:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.108500:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a9481a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389cb expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.108574:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94821 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.108587:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.108597:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430807.108962:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787430807.108966:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430807.108983:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.109010:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a9481a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389cb expref: 61 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.109027:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389cb expref: 60 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.109035:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430807.109038:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430807.109042:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02400, rc 0) 00000100:00100000:2.0:1787430807.109132:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:11374:x1874256836222080:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 675us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.109138:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:3.0:1787430807.112917:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.113003:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836222208 00000100:00100000:0.0:1787430807.113011:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836222208 00000100:00100000:0.0:1787430807.113063:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:0.0:1787430807.113073:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:11374:x1874256836222208:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430807.113090:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430807.113108:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94828 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389d2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113162:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113174:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113184:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113194:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113200:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113206:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113265:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113272:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113296:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430807.113333:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787430807.113337:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430807.113352:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113364:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113372:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113377:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113384:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113402:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430807.113416:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113424:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113435:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:0.0:1787430807.113438:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430807.113441:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113458:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9482f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113471:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113476:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113482:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113487:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430807.113490:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113495:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113503:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33400) 00010000:00010000:0.0:1787430807.113505:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430807.113508:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113513:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113534:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94828 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113546:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.113557:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:0.0:1787430807.113560:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430807.113562:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174800, rc 0) 00000100:00100000:0.0:1787430807.114036:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11374:x1874256836222208:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 962us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430807.114044:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:0.0:1787430807.118495:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.118792:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.119060:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836222464 00000100:00100000:2.0:1787430807.119070:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836222464 00000100:00100000:2.0:1787430807.119171:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:2.0:1787430807.119181:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11374:x1874256836222464:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430807.119201:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.119220:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94844 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389d9 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.119326:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.119339:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.119348:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.119355:0:8819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.119384:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.119417:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 62 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.119431:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847808384:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430807.119979:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.120003:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 62 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.120018:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847808512:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430807.120060:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430807.120357:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836222592 00000100:00100000:3.0:1787430807.120368:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836222592 00010000:00010000:3.0:1787430807.120388:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 63 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.120429:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:3.0:1787430807.120436:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:2400:x1874256836222592:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430807.120445:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430807.120451:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 63 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.120462:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 63 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.120479:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430807.120483:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.120490:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.120495:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430807.120714:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:2400:x1874256836222592:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 277us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.120720:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:1.0:1787430807.124137:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.124222:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836222720 00000100:00100000:3.0:1787430807.124231:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836222720 00010000:00010000:3.0:1787430807.124266:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 63 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.124321:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:3.0:1787430807.124330:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:2399:x1874256836222720:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430807.124347:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430807.124354:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 63 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.124368:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 63 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.124399:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430807.124414:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.124425:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.124432:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.124451:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430807.124512:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:2399:x1874256836222720:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 182us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.124519:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00010000:00010000:2.0:1787430807.125041:0:8819:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.25@tcp) returned -22 from blocking AST (req@0000000074aaee39 x1874256847808384) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 62 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.125055:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a9483d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d2 expref: 62 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.125069:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847808384:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430807.125080:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94813 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389c4 expref: 61 pid: 6498 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.125089:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847808512:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430807.125107:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.125112:0:8819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.125120:0:8819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.125125:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430807.125151:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787430807.125255:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94844 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 62 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.125267:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 61 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.125274:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.125277:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787430807.125279:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02e00, rc 0) 00000100:00100000:2.0:1787430807.125317:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11374:x1874256836222464:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 6137us (6830us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787430807.125323:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:1.0:1787430807.128809:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.128941:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836222976 00000100:00100000:3.0:1787430807.128951:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836222976 00000100:00100000:3.0:1787430807.129011:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:3.0:1787430807.129022:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11374:x1874256836222976:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:3.0:1787430807.129061:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430807.129089:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a9479c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389a8 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.129108:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430807.129112:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430807.129162:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:11374:x1874256836222976:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.129168:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1787430807.130888:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.130997:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836223104 00000100:00100000:3.0:1787430807.131004:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836223104 00000100:00100000:3.0:1787430807.131052:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:3.0:1787430807.131061:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:11374:x1874256836223104:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:3.0:1787430807.131166:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.131181:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.131192:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430807.131290:0:10098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787430807.131471:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:11374:x1874256836223104:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 407us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.131478:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:0.0:1787430807.133496:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.135812:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836223232 00000100:00100000:2.0:1787430807.135834:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836223232 00000100:00100000:2.0:1787430807.135919:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:2.0:1787430807.135930:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:11374:x1874256836223232:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430807.135947:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.135967:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389e0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.136068:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.136079:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.136113:0:6498:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.136125:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.136142:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.136145:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430807.136148:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.136155:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03a00, rc 0) 00000100:00100000:2.0:1787430807.136209:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11374:x1874256836223232:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 281us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.136215:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 122 00000040:00080000:3.0:1787430807.423925:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430807.423935:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430807.423982:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787430807.423991:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430807.424139:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847808640:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430807.424288:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430807.429787:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b034f8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847808640:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430807.430477:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.430640:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836223360 00000100:00100000:0.0:1787430807.430649:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836223360 00000100:00100000:0.0:1787430807.430705:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:0.0:1787430807.430716:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11375:x1874256836223360:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787430807.430748:0:13789:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787430807.430998:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11375:x1874256836223360:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 283us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430807.431007:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:0.0:1787430807.434071:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.434176:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836223488 00000100:00100000:2.0:1787430807.434187:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836223488 00000100:00100000:2.0:1787430807.434274:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:2.0:1787430807.434285:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11375:x1874256836223488:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787430807.434356:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434374:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434468:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434500:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434508:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434516:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434553:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434563:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434570:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430807.434633:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787430807.434637:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430807.434649:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434660:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434667:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434674:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434691:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.434696:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434703:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434716:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:2.0:1787430807.434719:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.434724:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434731:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94867 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434746:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434752:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434759:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434764:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.434767:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434774:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434792:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8e2b03b29500) 00010000:00010000:2.0:1787430807.434795:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.434798:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434804:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9486e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434818:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434892:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434899:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434904:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.434908:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434914:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434923:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.434926:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.434929:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.434934:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.435064:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11375:x1874256836223488:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 778us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.435072:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:3.0:1787430807.438285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.438375:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836223744 00000100:00100000:2.0:1787430807.438465:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836223744 00000100:00100000:2.0:1787430807.438654:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:2.0:1787430807.438667:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+61:11375:x1874256836223744:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430807.438688:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.438708:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a9487c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389e7 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.438814:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.438943:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.438954:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430807.438966:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787430807.439044:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439052:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439058:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439081:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.439085:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439094:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439107:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.439110:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430807.439115:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439121:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94883 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439161:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a9487c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e7 expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439172:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:2.0:1787430807.439174:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430807.439178:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a9487c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e7 expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.439187:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03000, rc 0) 00000100:00100000:2.0:1787430807.439291:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+62:11375:x1874256836223744:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 627us (1015us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787430807.439299:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:0.0:1787430807.442052:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.442129:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836223872 00000100:00100000:2.0:1787430807.442151:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836223872 00000100:00100000:2.0:1787430807.442228:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:2.0:1787430807.442238:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+62:11375:x1874256836223872:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787430807.442270:0:8819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787430807.442366:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+62:11375:x1874256836223872:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.442374:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:0.0:1787430807.446980:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.448550:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836224128 00000100:00100000:3.0:1787430807.448565:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836224128 00000100:00100000:3.0:1787430807.449022:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:3.0:1787430807.449035:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+62:11375:x1874256836224128:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430807.449056:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430807.449059:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787430807.449084:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a94821 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389cb expref: 62 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.449104:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430807.449109:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430807.449123:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94891 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389ee expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430807.450034:0:10098:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787430807.450189:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.450207:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.450219:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.450299:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94891 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389ee expref: 64 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.450316:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389ee expref: 63 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.450325:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:3.0:1787430807.450327:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430807.450331:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:3.0:1787430807.451035:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:11375:x1874256836224128:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1998us (4062us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787430807.451045:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:0.0:1787430807.458047:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.458139:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836224384 00000100:00100000:3.0:1787430807.458150:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836224384 00000100:00100000:3.0:1787430807.458222:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:3.0:1787430807.458234:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:11375:x1874256836224384:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787430807.458293:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430807.458320:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389ee expref: 63 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458343:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2c132d1d00) 00010000:00010000:3.0:1787430807.458354:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430807.458376:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458413:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458439:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458477:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458487:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458494:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458558:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458566:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458572:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458578:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430807.458583:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458592:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458634:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:3.0:1787430807.458638:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430807.458642:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458657:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a948a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458669:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458675:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458681:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458686:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430807.458690:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458697:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458705:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3dc1c066 (ffff8e2c132d1000) 00010000:00010000:3.0:1787430807.458708:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430807.458710:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.458716:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a948ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3dc1c066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.458794:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+62:11375:x1874256836224384:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 562us (3273us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430807.458801:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:0.0:1787430807.461177:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.461267:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836224512 00000100:00100000:2.0:1787430807.461276:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836224512 00000100:00100000:2.0:1787430807.461335:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:2.0:1787430807.461345:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+62:11375:x1874256836224512:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430807.461363:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.461384:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a948b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389f5 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.461442:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.461454:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.461464:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.461577:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a948b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 64 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.461595:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 63 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.461666:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:2.0:1787430807.461669:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430807.461673:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03400, rc 0) 00000100:00100000:2.0:1787430807.461720:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:11375:x1874256836224512:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 375us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.461727:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:0.0:1787430807.464326:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.464416:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836224768 00000100:00100000:2.0:1787430807.464425:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836224768 00000100:00100000:2.0:1787430807.464480:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:2.0:1787430807.464491:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:11375:x1874256836224768:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787430807.464562:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.464577:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.464587:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430807.464768:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787430807.464779:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 268937177062ns, next at 269937174339ns, rc = 0 00000004:00010000:2.0:1787430807.464835:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c226dbb2 reply state 0000000069f777bf transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.464848:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.464856:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:2.0:1787430807.464870:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787430807.464874:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430807.464962:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:11375:x1874256836224768:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 471us (643us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787430807.464970:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:0.0:1787430807.467054:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.467139:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836224896 00000100:00100000:3.0:1787430807.467147:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836224896 00000100:00100000:3.0:1787430807.467197:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:3.0:1787430807.467207:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:11375:x1874256836224896:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430807.467225:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430807.467244:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b91389fc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.467293:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.467307:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.467325:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:3.0:1787430807.467327:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430807.467331:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491600, rc 0) 00000100:00100000:3.0:1787430807.467381:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:11375:x1874256836224896:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 175us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.467388:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:0.0:1787430807.470056:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.470137:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836225024 00000100:00100000:3.0:1787430807.470146:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836225024 00000100:00100000:3.0:1787430807.470211:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:3.0:1787430807.470222:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836225024:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787430807.470545:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430807.470597:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2400:x1874256836225024:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 376us (548us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787430807.471336:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:0.0:1787430807.472804:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.472902:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836225280 00000100:00100000:3.0:1787430807.472910:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836225280 00000100:00100000:3.0:1787430807.472966:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:3.0:1787430807.472976:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:11375:x1874256836225280:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787430807.473512:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:11375:x1874256836225280:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 535us (711us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1787430807.473521:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:0.0:1787430807.475177:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.475259:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836225536 00000100:00100000:2.0:1787430807.475267:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836225536 00000100:00100000:2.0:1787430807.475340:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:2.0:1787430807.475350:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:11375:x1874256836225536:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787430807.475488:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:11375:x1874256836225536:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.475495:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:0.0:1787430807.476783:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.477449:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836225664 00000100:00100000:2.0:1787430807.477457:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836225664 00000100:00100000:2.0:1787430807.477508:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:2.0:1787430807.477516:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:11375:x1874256836225664:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430807.477530:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.477628:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a948d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a03 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.477701:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a948d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.477714:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a948d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.477725:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a948d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430807.477771:0:13789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430807.477785:0:13789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a948d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.477807:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a948d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a03 expref: 69 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.477823:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a948d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a03 expref: 68 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.477832:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:2.0:1787430807.477834:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787430807.477838:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02600, rc 0) 00000100:00100000:2.0:1787430807.477887:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:11375:x1874256836225664:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 371us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.477894:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:0.0:1787430807.482951:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.483168:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836225792 00000100:00100000:2.0:1787430807.483180:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836225792 00000100:00100000:2.0:1787430807.483238:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1787430807.483250:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2399:x1874256836225792:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430807.483270:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430807.483289:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a0a expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430807.483315:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0797, blocks: 0x0 00010000:00010000:2.0:1787430807.483336:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=268s v=(0 0) 00010000:00010000:2.0:1787430807.483354:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430807.483364:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.483385:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.483419:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03000, rc 0) 00000100:00100000:2.0:1787430807.483543:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:2399:x1874256836225792:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 294us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.483551:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:0.0:1787430807.485382:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.485537:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836226048 00000100:00100000:3.0:1787430807.485544:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836226048 00000100:00100000:3.0:1787430807.485597:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:3.0:1787430807.485626:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:11375:x1874256836226048:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787430807.485746:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:11375:x1874256836226048:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 121us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.485751:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:0.0:1787430807.487084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.487150:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836226176 00000100:00100000:3.0:1787430807.487155:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836226176 00000100:00100000:3.0:1787430807.487224:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1787430807.487230:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:11375:x1874256836226176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430807.487239:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430807.487251:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a11 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.487273:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.487279:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430807.487287:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430807.487291:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.487317:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.487327:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 11 pid: 8409 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.487338:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847808768:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430807.487423:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430807.489026:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847808768:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430807.489047:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.489060:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491400, rc 0) 00000100:00100000:3.0:1787430807.489096:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:11375:x1874256836226176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1866us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.489101:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:0.0:1787430807.490234:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.490287:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836226304 00000100:00100000:3.0:1787430807.490293:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836226304 00010000:00010000:3.0:1787430807.490318:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 11 pid: 8409 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.490345:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:3.0:1787430807.490367:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:2400:x1874256836226304:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430807.490380:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430807.490416:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 11 pid: 8409 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.490431:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 11 pid: 8409 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.490457:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a948de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a0a expref: 11 pid: 8409 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.490472:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430807.490477:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430807.490485:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.490495:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.490535:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.490550:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1874256847808896:192.168.202.25@tcp:105: 00000100:00100000:3.0:1787430807.490685:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430807.492808:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.492898:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836226432 00000100:00100000:1.0:1787430807.492920:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836226432 00002000:00100000:1.0:1787430807.492964:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8e2b048fd880 x1874256836226432/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:28/0 lens 504/0 e 0 to 0 dl 1787430818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430807.492976:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b048fd880 with x1874256836226432 ext(0->12) 00002000:00010000:1.0:1787430807.492980:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b048fd880 00000100:00100000:1.0:1787430807.493021:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1787430807.493030:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:2400:x1874256836226432:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787430807.493927:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2400:x1874256836226432:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 895us (1124us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787430807.493937:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00002000:00100000:1.0:1787430807.493944:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8e2b048fd880 x1874256836226432/t4294967309(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:28/0 lens 504/448 e 0 to 0 dl 1787430818 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430807.493954:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b048fd880 with x1874256836226432 ext(0->12) 00002000:00010000:1.0:1787430807.493958:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b048fd880 00000100:00100000:3.0:1787430807.494103:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1874256847808896:192.168.202.25@tcp:105: 00010000:00010000:3.0:1787430807.494128:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430807.494145:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:2400:x1874256836226304:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 3782us (3915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.494152:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:2.0:1787430807.495849:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.495891:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836226560 00000100:00100000:3.0:1787430807.495898:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836226560 00000100:00100000:3.0:1787430807.495978:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:3.0:1787430807.495986:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:11375:x1874256836226560:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787430807.497142:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1787430807.497157:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:2.0:1787430807.497182:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497194:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497201:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497207:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.497211:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497218:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430807.497223:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1787430807.497233:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2c132d1100) 00010000:00010000:2.0:1787430807.497243:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1787430807.497245:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2b03af3cc0 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:2.0:1787430807.497248:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787430807.497248:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b03af3e40 00000020:00080000:1.0:1787430807.497252:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b0352e400 00010000:00010000:2.0:1787430807.497255:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a945ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430807.497272:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:2.0:1787430807.497279:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497285:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497291:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497296:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.497299:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497304:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497312:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2b0353fb00) 00010000:00010000:2.0:1787430807.497314:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.497316:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497321:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94692 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497335:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497350:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497356:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.497357:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847809024:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787430807.497361:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.497363:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497369:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497376:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33400) 00010000:00010000:2.0:1787430807.497379:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.497382:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497387:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94710 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497399:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497418:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497423:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497428:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc1a5e4f0) 00000100:00100000:0.0:1787430807.497434:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430807.497436:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497442:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497449:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03b33400) 00010000:00010000:2.0:1787430807.497451:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.497454:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497459:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94733 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497473:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.497478:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847809024 00010000:00010000:2.0:1787430807.497479:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.497482:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847809024 00010000:00010000:2.0:1787430807.497484:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497489:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.497491:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497496:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497503:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.497505:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.497513:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497519:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94805 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.497521:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787430807.497531:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847809024:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787430807.497532:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497538:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497543:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497548:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc1a5e4f0) 00002000:00080000:0.0:1787430807.497550:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1787430807.497551:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497556:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497563:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:2.0:1787430807.497566:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430807.497568:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497573:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a948c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430807.497583:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a0796, atime: 0x6a8a0796, ctime: 0x6a8a0796, blocks: 0x8 00010000:00010000:0.0:1787430807.497590:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.497630:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1787430807.497635:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430807.497643:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787430807.497647:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1787430807.497656:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1787430807.497656:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.497677:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.497685:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.497705:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430807.497738:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430807.497748:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497755:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430807.497759:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497766:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497780:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497787:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a948ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.497800:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430807.497802:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430807.497803:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430807.497838:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3628:x1874256847809024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 309us (403us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787430807.497846:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:2.0:1787430807.497857:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b048fc700/2, rc 0, transno 4294967305 00000100:00100000:2.0:1787430807.497863:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847809024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787430807.498036:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430807.498046:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847809280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787430807.498088:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430807.498181:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847809152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787430807.498186:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847809280 00000100:00100000:0.0:1787430807.498190:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847809280 00000100:00100000:2.0:1787430807.498219:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430807.498222:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430807.498229:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3630:x1874256847809280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787430807.498311:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787430807.498315:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787430807 00002000:00010000:0.0:1787430807.498317:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787430807.498319:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787430807 -> 1787430807 00002000:00010000:0.0:1787430807.498322:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787430807.498363:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847809280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (274us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787430807.498369:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430807.498379:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847809152 00000100:00100000:0.0:1787430807.498392:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847809152 00000100:00100000:0.0:1787430807.498423:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787430807.498434:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847809152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787430807.498470:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1787430807.498485:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.498501:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 11 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.498509:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787430807.498512:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430807.498517:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.498541:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 11 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.498555:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 11 pid: 11754 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.498567:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8409:1874256847809408:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430807.498647:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee780 going to sleep for 11 seconds 00000100:00080000:0.0:1787430807.498659:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787430807.498697:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2b03c35000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787430807.498701:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35f9e500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b03c35f00 00000020:00080000:1.0:1787430807.498704:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35f9e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2c35e15200 00000100:00100000:3.0:1787430807.498923:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11375:x1874256836226560:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 2936us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.498932:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 135 00000004:00080000:2.0:1787430807.499778:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b04939180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787430807.499796:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847809280:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1787430807.499810:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787430807.499859:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787430807.501897:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.501978:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836226816 00000100:00100000:1.0:1787430807.501987:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836226816 00000100:00100000:0.0:1787430807.502059:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8409:1874256847809408:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430807.502086:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00010000:00010000:0.0:1787430807.502086:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.502095:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:2400:x1874256836226816:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787430807.503888:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787430807.503903:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787430807.504198:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.504397:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836226816:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 2301us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430807.504414:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1787430807.504756:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836226688 00000100:00100000:3.0:1787430807.504766:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836226688 00010000:00010000:3.0:1787430807.504802:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 7 pid: 11754 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.504848:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:3.0:1787430807.504858:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11441c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836226688:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430807.504870:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430807.504875:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 7 pid: 11754 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.504889:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 7 pid: 11754 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.504911:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038dec056/0x4dbb683ba6a946a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138969 expref: 7 pid: 11754 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.504938:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430807.504942:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430807.504949:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.504959:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.505126:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430807.505162:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11441c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836226688:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 305us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.505170:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00010000:00010000:0.0:1787430807.505446:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.505464:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.505474:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.505482:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.505508:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430807.505527:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430807.505534:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.505543:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430807.505547:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.505556:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.505569:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.505576:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5d3b73b/0x4dbb683ba6a948f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.505595:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430807.505596:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430807.505619:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430807.505727:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3630:x1874256847809152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7296us (7506us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787430807.505735:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787430807.505860:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787430807.505867:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1787430807.505889:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b04939180, transno 4294967310 00000100:00100000:2.0:1787430807.505910:0:3630:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8e2b03d9d180 x1874256847809152/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787430823 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787430807.505922:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b03d9d180/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787430807.505927:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847809152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787430807.507464:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.507560:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836227072 00000100:00100000:0.0:1787430807.507567:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836227072 00000100:00100000:1.0:1787430807.507837:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:1.0:1787430807.507846:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11375:x1874256836227072:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430807.507894:0:13789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430807.507917:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a948d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a03 expref: 16 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.507932:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:1.0:1787430807.507936:0:13789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430807.507965:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.507978:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.507986:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430807.508078:0:13789:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f83d0be3 reply state 000000002426d5c6 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.508091:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.508110:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:1.0:1787430807.508112:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787430807.508114:0:13789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430807.508200:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:11375:x1874256836227072:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 355us (744us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787430807.508205:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:2.0:1787430807.509571:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.509816:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836227200 00000100:00100000:0.0:1787430807.509822:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836227200 00000100:00100000:1.0:1787430807.509922:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:1.0:1787430807.509929:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2402:x1874256836227200:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787430807.510028:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787430807.510031:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787430807 -> 1787430807 00002000:00010000:1.0:1787430807.510033:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787430806 00002000:00010000:1.0:1787430807.510034:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787430807 -> 1787430807 00002000:00010000:1.0:1787430807.510036:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787430807.510073:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836227200:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 145us (508us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787430807.510077:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:2.0:1787430807.511346:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.511411:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836227456 00000100:00100000:3.0:1787430807.511419:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836227456 00000100:00100000:3.0:1787430807.511466:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:3.0:1787430807.511473:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:11375:x1874256836227456:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787430807.511533:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.511545:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 17 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.511552:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.511580:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 17 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430807.511629:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 17 pid: 13789 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.511639:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04939180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847809536:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430807.511691:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430807.513474:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04939180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847809536:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430807.513508:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430807.514092:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430807.514179:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836227584 00000100:00100000:2.0:1787430807.514185:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836227584 00010000:00010000:2.0:1787430807.514215:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 18 pid: 13789 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.514269:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:2.0:1787430807.514278:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2399:x1874256836227584:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430807.514288:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430807.514293:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 18 pid: 13789 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.514306:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 18 pid: 13789 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.514324:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a948bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389f5 expref: 18 pid: 13789 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.514354:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:2.0:1787430807.514357:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.514365:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.514370:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.514388:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430807.514424:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.514431:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.514454:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:2399:x1874256836227584:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 175us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.514460:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00010000:00010000:0.0:1787430807.514477:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.514484:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.514490:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.514496:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430807.514501:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.514508:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.514516:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:0.0:1787430807.514519:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787430807.514789:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.514809:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a94901 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.514922:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11375:x1874256836227456:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 3429us (3560us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787430807.514937:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:3.0:1787430807.516671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.516918:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836227712 00000100:00100000:0.0:1787430807.516928:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836227712 00000100:00100000:0.0:1787430807.516981:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:0.0:1787430807.517003:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836227712:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787430807.517046:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.517066:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.517089:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430807.517104:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430807.517107:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.517136:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.517145:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 7 pid: 8411 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.517156:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847809664:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430807.517217:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430807.518810:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.518966:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847809664:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430807.519018:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.519093:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836227840 00000100:00100000:1.0:1787430807.519098:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836227840 00010000:00010000:1.0:1787430807.519123:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 8 pid: 8411 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.519154:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:1.0:1787430807.519164:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836227840:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430807.519177:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430807.519197:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 8 pid: 8411 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.519217:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 8 pid: 8411 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.519234:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad4f4f9a/0x4dbb683ba6a948e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a11 expref: 8 pid: 8411 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.519246:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430807.519250:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430807.519254:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.519260:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.519305:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430807.519344:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836227840:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 182us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430807.519352:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00010000:00010000:0.0:1787430807.519391:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519420:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519439:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519448:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519456:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519464:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430807.519468:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519477:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519490:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.519498:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a94908 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.519564:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836227712:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 2563us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430807.519572:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:3.0:1787430807.521451:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.521533:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836228096 00000100:00100000:0.0:1787430807.521540:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836228096 00000100:00100000:0.0:1787430807.521584:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:0.0:1787430807.521592:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:11375:x1874256836228096:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787430807.521673:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.521685:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 16 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.521692:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.521715:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 16 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.521723:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 16 pid: 10098 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.521734:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847809792:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430807.521963:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430807.523505:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.523698:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836228224 00000100:00100000:1.0:1787430807.523706:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836228224 00010000:00010000:1.0:1787430807.523744:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 17 pid: 10098 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.523814:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:1.0:1787430807.523823:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:2400:x1874256836228224:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430807.523855:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430807.523863:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 17 pid: 10098 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.523876:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 17 pid: 10098 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.523893:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430807.523897:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.523904:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.523909:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.523913:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.523925:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430807.524025:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:2400:x1874256836228224:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 203us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430807.524030:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 76 00010000:00010000:0.0:1787430807.524218:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a947fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389bd expref: 16 pid: 10098 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.524248:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847809792:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430807.524269:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.524278:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.524284:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.524473:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.524491:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.524499:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.524847:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.524861:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 16 pid: 6496 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.524875:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847809920:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430807.525038:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430807.526369:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847809920:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430807.526418:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.526755:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.526843:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836228352 00000100:00100000:0.0:1787430807.526856:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836228352 00010000:00010000:0.0:1787430807.526918:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 17 pid: 6496 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.526950:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:0.0:1787430807.527016:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:2400:x1874256836228352:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430807.527043:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430807.527050:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 17 pid: 6496 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.527087:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 17 pid: 6496 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.527126:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a948c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389fc expref: 17 pid: 6496 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.527155:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:0.0:1787430807.527171:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.527179:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.527184:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.527216:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430807.527318:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:2400:x1874256836228352:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 360us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430807.527330:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 77 00010000:00010000:1.0:1787430807.527385:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.527390:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430807.527511:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787430807.527983:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1787430807.528022:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787430807.528095:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847810048:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787430807.528172:0:10098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430807.528201:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430807.528280:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847810048 00000100:00100000:2.0:1787430807.528285:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847810048 00000100:00100000:2.0:1787430807.528355:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787430807.528364:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10098:x1874256847810048:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787430807.528471:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10098:x1874256847810048:12345-0@lo:1000:mdt00_004.0 Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.528479:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787430807.528547:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847810048:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787430807.528674:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787430807.528714:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847810176:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787430807.528742:0:10098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430807.529008:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430807.529035:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847810176 00000100:00100000:3.0:1787430807.529039:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847810176 00000100:00100000:3.0:1787430807.529064:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787430807.529069:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10098:x1874256847810176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787430807.529181:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10098:x1874256847810176:12345-0@lo:1000:mdt00_004.0 Request processed in 111us (439us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787430807.529188:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787430807.529261:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847810176:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787430807.529283:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529289:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529294:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529297:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430807.529310:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529315:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529326:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:1.0:1787430807.529328:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430807.529331:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529334:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94916 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529353:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529357:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529360:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529363:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8aa00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430807.529364:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529368:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529372:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430807.529373:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430807.529437:0:10098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529450:0:10098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529456:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.529476:0:10098:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.529482:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847810304:192.168.202.25@tcp:105: 00000100:00100000:1.0:1787430807.529539:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430807.531456:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.531473:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847810304:192.168.202.25@tcp:105: 00010000:00010000:1.0:1787430807.531501:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531511:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94859 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430807.531518:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836228480 00000100:00100000:0.0:1787430807.531524:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836228480 00000100:00100000:0.0:1787430807.531579:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:0.0:1787430807.531589:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:11374:x1874256836228480:12345-192.168.202.25@tcp:49:lfs.0 00010000:00010000:1.0:1787430807.531596:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531629:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531639:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531665:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531671:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531677:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531682:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430807.531686:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531692:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531702:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430807.531705:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430807.531708:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531714:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9491d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531724:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531730:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531735:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531746:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430807.531750:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531756:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531765:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00000100:00100000:0.0:1787430807.531830:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:11374:x1874256836228480:12345-192.168.202.25@tcp:49:lfs.0 Request processed in 232us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430807.531838:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00010000:00010000:1.0:1787430807.531844:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787430807.531849:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.531855:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a9490f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.532094:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:11375:x1874256836228096:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 10501us (10650us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787430807.532102:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 138 00000020:00080000:1.0:1787430807.532106:0:10098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787430807.532217:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430807.532221:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430807.532589:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787430807.532598:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430807.535377:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430807.535592:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836228736 00000100:00100000:3.0:1787430807.535627:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836228736 00000100:00100000:3.0:1787430807.535682:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:3.0:1787430807.535694:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:11374:x1874256836228736:12345-192.168.202.25@tcp:58:lfs.0 00000040:00080000:3.0:1787430807.535846:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787430807.535918:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:11374:x1874256836228736:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 226us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.535940:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:3.0:1787430807.537186:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.537430:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836228992 00000100:00100000:0.0:1787430807.537436:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836228992 00000100:00100000:0.0:1787430807.537490:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:0.0:1787430807.537499:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e5a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:11375:x1874256836228992:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787430807.537780:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787430807.537816:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1787430807.537862:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.537880:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.537892:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.537900:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.537916:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.537920:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.537973:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787430807.538082:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e5a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:11375:x1874256836228992:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 582us (900us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787430807.538090:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000020:00080000:1.0:1787430807.538095:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787430807.538337:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430807.538343:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.538348:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430807.538351:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.538356:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.538366:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:0.0:1787430807.538368:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787430807.538371:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.538375:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94924 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430807.538393:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430807.538394:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430807.538395:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430807.551796:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430807.553352:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430807.553452:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836229120 00000100:00100000:0.0:1787430807.553460:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836229120 00000100:00100000:0.0:1787430807.553509:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:1.0:1787430807.553756:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:11377:x1874256836229120:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430807.553786:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430807.553802:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9492b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a18 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553883:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553894:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553902:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553912:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553916:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553920:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553973:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553979:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 22 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.553985:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.554009:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 22 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.554026:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 22 pid: 8819 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.554037:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1874256847810432:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430807.554115:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430807.556883:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1874256847810432:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430807.556949:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430807.557461:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.557557:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836229376 00000100:00100000:1.0:1787430807.557577:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836229376 00000100:00100000:1.0:1787430807.557716:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1787430807.557727:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:6159:x1874256836229376:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787430807.557947:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:6159:x1874256836229376:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 222us (487us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787430807.557956:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:2.0:1787430807.559961:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430807.560003:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836229504 00000100:00100000:1.0:1787430807.560011:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836229504 00010000:00010000:1.0:1787430807.560046:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 24 pid: 8819 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.560077:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:1.0:1787430807.560087:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:2400:x1874256836229504:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430807.560101:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430807.560121:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 24 pid: 8819 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.560132:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 24 pid: 8819 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.560150:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9484b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389d9 expref: 24 pid: 8819 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.560161:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430807.560164:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.560171:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.560176:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430807.560198:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430807.560224:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560238:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430807.560247:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2400:x1874256836229504:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 162us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430807.560254:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 78 00000004:00200000:2.0:1787430807.560288:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787430807.560293:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430807.560312:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560325:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560334:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560341:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560348:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560354:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.560357:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560365:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.560374:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:2.0:1787430807.560377:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.560381:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561307:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94932 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561320:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561324:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561328:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561331:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430807.561334:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561337:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561345:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2b03540100) 00010000:00010000:2.0:1787430807.561347:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430807.561349:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561352:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561383:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a9492b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a18 expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561411:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a18 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430807.561429:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:2.0:1787430807.561431:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430807.561434:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031800, rc 0) 00000100:00100000:2.0:1787430807.561512:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11377:x1874256836229120:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 7809us (8164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430807.561518:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:3.0:1787430808.322080:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847810560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430808.322155:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430808.322247:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847810560 00000100:00100000:3.0:1787430808.322254:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847810560 00000100:00100000:3.0:1787430808.322309:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787430808.322318:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847810560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787430808.322342:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1787430808.322384:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847810560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430808.322392:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787430808.322427:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430808.322463:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847810560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430808.322665:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430808.322675:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847810688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430808.322705:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430808.322739:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847810688 00000100:00100000:0.0:1787430808.322743:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847810688 00000100:00100000:0.0:1787430808.322772:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787430808.322779:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847810688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787430808.322802:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787430808.322900:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847810688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430808.322907:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787430808.323006:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847810688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430808.326019:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847810816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430808.326079:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430808.326936:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847810816 00000100:00100000:1.0:1787430808.326945:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847810816 00000100:00100000:1.0:1787430808.326991:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787430808.327002:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847810816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430808.327025:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1787430808.327074:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847810816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430808.327089:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787430808.327138:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847810816:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787430808.396737:0:14232:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430808.396747:0:14232:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430808.396780:0:14232:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787430808.396788:0:14232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787430808.578543:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430808.578794:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430808.578800:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430808.578835:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787430808.578843:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430808.578990:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847810944:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430808.579088:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787430808.584752:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847810944:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430808.587756:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430808.587907:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836229632 00000100:00100000:0.0:1787430808.587917:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836229632 00000100:00100000:0.0:1787430808.587997:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:0.0:1787430808.588009:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11389:x1874256836229632:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787430808.588046:0:8819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787430808.588161:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11389:x1874256836229632:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 154us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430808.588169:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00080000:3.0:1787430808.589429:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430808.592479:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430808.592565:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836229888 00000100:00100000:0.0:1787430808.592574:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836229888 00000100:00100000:0.0:1787430808.592653:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:0.0:1787430808.592665:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:11389:x1874256836229888:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430808.592699:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430808.592719:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94947 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a1f expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430808.592840:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a9494e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430808.592864:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a9494e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430808.592877:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a9494e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430808.592889:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787430808.592999:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94947 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a1f expref: 25 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430808.593017:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a9494e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a1f expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430808.593026:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:0.0:1787430808.593029:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430808.593033:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174c00, rc 0) 00000100:00100000:0.0:1787430808.593086:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:11389:x1874256836229888:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 424us (614us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787430808.593093:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:0.0:1787430808.601577:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430808.601645:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430808.601719:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836230144 00000100:00100000:3.0:1787430808.601729:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836230144 00000100:00100000:3.0:1787430808.601791:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:3.0:1787430808.601802:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:11389:x1874256836230144:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787430808.601897:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.601916:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.601940:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.602784:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.602796:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.602803:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.602809:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430808.602813:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.602820:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.602834:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430808.602837:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430808.602841:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.602846:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a9495c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430808.602967:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:11389:x1874256836230144:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 1165us (1395us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787430808.602975:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 143 00000040:00080000:3.0:1787430808.603081:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430808.603086:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430808.603591:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787430808.603617:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787430808.605321:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836230272 00000100:00100000:1.0:1787430808.605334:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836230272 00000100:00100000:1.0:1787430808.605426:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:1.0:1787430808.605438:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:2401:x1874256836230272:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430808.605454:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430808.605477:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a9494e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a1f expref: 25 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430808.605496:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430808.605500:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430808.605559:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:2401:x1874256836230272:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 123us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430808.605567:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1787430808.615819:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430808.615997:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836230528 00000100:00100000:1.0:1787430808.616007:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836230528 00000100:00100000:1.0:1787430808.616058:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:1.0:1787430808.616069:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:11389:x1874256836230528:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787430808.616271:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:11389:x1874256836230528:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 203us (469us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787430808.616279:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:3.0:1787430809.597941:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430809.597992:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430809.598053:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836230656 00000100:00100000:1.0:1787430809.598068:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836230656 00000100:00100000:1.0:1787430809.598119:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 362 00000100:00100000:1.0:1787430809.598130:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836230656:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430809.598204:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836230656:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430809.598210:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 362 00000100:00100000:3.0:1787430809.598407:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430809.598437:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430809.598459:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430809.598747:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836230784 00000100:00100000:2.0:1787430809.598753:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836230784 00000100:00100000:2.0:1787430809.598792:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836230912 00000100:00100000:2.0:1787430809.598796:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836230912 00000100:00100000:2.0:1787430809.598838:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:2.0:1787430809.598847:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:2402:x1874256836230784:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430809.598895:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:2402:x1874256836230784:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 49us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430809.598913:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:2.0:1787430809.598930:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 202 00000100:00100000:2.0:1787430809.598936:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836230912:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430809.598962:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836230912:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430809.598967:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 202 00000100:00080000:2.0:1787430809.598997:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787430809.599174:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430809.599260:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430809.599283:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836231296 00000100:00100000:3.0:1787430809.599288:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836231296 00000100:00100000:3.0:1787430809.599319:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836231424 00000100:00100000:3.0:1787430809.599323:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836231424 00000100:00100000:3.0:1787430809.599345:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 203 00000100:00100000:3.0:1787430809.599352:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836231296:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430809.599759:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 204 00000100:00100000:1.0:1787430809.599769:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836231424:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430809.599853:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836231040 00000100:00100000:2.0:1787430809.599858:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836231040 00000100:00100000:2.0:1787430809.599895:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836231168 00000100:00100000:2.0:1787430809.599898:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836231168 00000100:00100000:2.0:1787430809.599920:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:2.0:1787430809.599927:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836231040:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430809.600208:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836231296:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 855us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430809.600239:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 203 00000100:00100000:3.0:1787430809.600268:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:3.0:1787430809.600277:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836231168:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430809.601419:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836231424:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1602us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430809.601452:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836231040:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1524us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430809.601460:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 84 00010000:00010000:2.0:1787430809.601562:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430809.601621:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430809.601627:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430809.601632:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430809.601636:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430809.602202:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 204 00000100:00100000:3.0:1787430809.603870:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836231168:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 3586us (5401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430809.603883:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 85 00010000:00010000:0.0:1787430810.623978:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430810.879893:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847811072:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880014:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880082:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847811712:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880113:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880136:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847812224:0@lo:400:kworker.0 00000100:00100000:3.0:1787430810.880155:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811072 00000100:00100000:3.0:1787430810.880166:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811072 00000100:00100000:1.0:1787430810.880177:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880197:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847812736:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880219:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880245:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787430810.880249:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787430810.880251:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847811584:0@lo:400:kworker.0 00000100:00100000:3.0:1787430810.880259:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847811072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880277:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880296:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847812096:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880319:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880336:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847812608:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880366:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880410:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847811328:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880435:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880461:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847811840:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880483:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880500:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847812352:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880520:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880538:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847812864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430810.880560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880579:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787430810.880585:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847811456:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880641:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880664:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847811968:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880687:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880705:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847812480:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880724:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880741:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847811200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430810.880762:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430810.880797:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811712 00000100:00100000:1.0:1787430810.880801:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811712 00000100:00100000:1.0:1787430810.880834:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811456 00000100:00100000:1.0:1787430810.880837:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811456 00000100:00100000:1.0:1787430810.880853:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787430810.880859:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847811712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.880932:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847811712:12345-0@lo:400:kworker.0 Request processed in 71us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.880949:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787430810.880966:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787430810.880972:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847811456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881006:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847811456:12345-0@lo:400:kworker.0 Request processed in 34us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881012:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787430810.881031:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812224 00000100:00100000:1.0:1787430810.881035:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812224 00000100:00100000:1.0:1787430810.881073:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812736 00000100:00100000:1.0:1787430810.881076:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812736 00000100:00100000:1.0:1787430810.881090:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812096 00000100:00100000:1.0:1787430810.881093:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812096 00000100:00100000:1.0:1787430810.881105:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812608 00000100:00100000:1.0:1787430810.881108:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812608 00000100:00100000:1.0:1787430810.881121:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787430810.881127:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847812224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881164:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847812224:12345-0@lo:400:kworker.0 Request processed in 37us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881170:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787430810.881182:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787430810.881188:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847812736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881216:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847812736:12345-0@lo:400:kworker.0 Request processed in 29us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881223:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787430810.881233:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787430810.881239:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847812096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881281:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847812096:12345-0@lo:400:kworker.0 Request processed in 42us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881286:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787430810.881298:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787430810.881304:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847812608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881328:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847812608:12345-0@lo:400:kworker.0 Request processed in 25us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881335:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787430810.881363:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811584 00000100:00100000:1.0:1787430810.881367:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811584 00000100:00100000:1.0:1787430810.881399:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811328 00000100:00100000:1.0:1787430810.881402:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811328 00000100:00100000:1.0:1787430810.881411:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811840 00000100:00100000:1.0:1787430810.881413:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811840 00000100:00100000:1.0:1787430810.881424:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812352 00000100:00100000:1.0:1787430810.881426:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812352 00000100:00100000:1.0:1787430810.881435:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811968 00000100:00100000:1.0:1787430810.881438:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811968 00000100:00100000:1.0:1787430810.881449:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812480 00000100:00100000:1.0:1787430810.881451:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812480 00000100:00100000:1.0:1787430810.881462:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787430810.881468:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847811584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881501:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847811584:12345-0@lo:400:kworker.0 Request processed in 33us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881507:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787430810.881518:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787430810.881524:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847811328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881551:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847811328:12345-0@lo:400:kworker.0 Request processed in 28us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881563:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787430810.881575:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787430810.881580:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847811840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881641:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847811840:12345-0@lo:400:kworker.0 Request processed in 61us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881648:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787430810.881660:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787430810.881666:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847812352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881691:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847812352:12345-0@lo:400:kworker.0 Request processed in 26us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881697:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787430810.881707:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787430810.881713:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847811968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881739:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847811968:12345-0@lo:400:kworker.0 Request processed in 27us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881745:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787430810.881757:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787430810.881762:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847812480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.881788:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847812480:12345-0@lo:400:kworker.0 Request processed in 26us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881794:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787430810.881840:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812864 00000100:00100000:1.0:1787430810.881844:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812864 00000100:00100000:1.0:1787430810.881872:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847811200 00000100:00100000:1.0:1787430810.881875:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847811200 00000100:00100000:1.0:1787430810.881896:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787430810.881901:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847812864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430810.881931:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430810.881967:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847812864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.881973:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787430810.881983:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787430810.881988:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847811200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787430810.881997:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430810.882019:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847811200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430810.882025:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787430810.882067:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430810.882071:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430810.882074:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430810.882076:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430810.882127:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847811456:0@lo:400:kworker.0 00010000:00080000:1.0:1787430810.882145:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd5f80 x1874256847811968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430810.882155:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847811968:0@lo:400:kworker.0 00010000:00080000:1.0:1787430810.882166:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd7480 x1874256847812480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430810.882193:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847812480:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882213:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847811200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430810.882226:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847811328:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882250:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847811840:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882260:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847812352:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882276:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847812864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430810.882337:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847811584:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882349:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847812096:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882359:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847812608:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882379:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847811712:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882393:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847812224:0@lo:400:kworker.0 00000100:00100000:1.0:1787430810.882402:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847812736:0@lo:400:kworker.0 00000100:00100000:3.0:1787430810.882553:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c2e111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847811072:12345-0@lo:400:kworker.0 Request processed in 2292us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430810.882566:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787430810.885455:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847812992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430810.885559:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430810.886187:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847812992 00000100:00100000:3.0:1787430810.886202:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847812992 00000100:00100000:3.0:1787430810.886361:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787430810.886385:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847812992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430810.886435:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430810.886513:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847812992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430810.886520:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787430810.886582:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847812992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430810.888106:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847811072:0@lo:400:kworker.0 00000040:00080000:2.0:1787430811.074869:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787430811.291299:0:14284:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430811.291314:0:14284:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430811.291361:0:14284:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787430811.292671:0:14284:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430811.613687:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430811.613823:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836231680 00000100:00100000:3.0:1787430811.613833:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836231680 00000100:00100000:3.0:1787430811.613908:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:3.0:1787430811.613919:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:11410:x1874256836231680:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430811.613939:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430811.613959:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94963 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a26 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430811.614084:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9496a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430811.614100:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9496a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430811.614125:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9496a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430811.614139:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787430811.614248:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94963 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a26 expref: 28 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430811.614267:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9496a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a26 expref: 27 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430811.614275:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:3.0:1787430811.614278:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787430811.614282:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:3.0:1787430811.614339:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:11410:x1874256836231680:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 422us (662us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787430811.614548:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00080000:0.0:1787430811.616176:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430811.628538:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430811.644024:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836231808 00000100:00100000:1.0:1787430811.644042:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836231808 00000100:00100000:1.0:1787430811.644128:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:1.0:1787430811.644141:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:11410:x1874256836231808:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:1.0:1787430811.644226:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.644248:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.644263:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.644320:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.644327:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.644333:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.644340:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430811.644344:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.645331:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.645492:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430811.645497:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430811.645503:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.645511:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031400/0x4dbb683ba6a94978 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430811.645795:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:11410:x1874256836231808:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 1644us (17255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430811.645805:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 145 00000040:00080000:3.0:1787430811.648615:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430811.648638:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430811.648659:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787430811.648665:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787430811.650472:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430811.952085:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430811.952219:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836231936 00000100:00100000:1.0:1787430811.952230:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836231936 00000100:00100000:1.0:1787430811.952309:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:1.0:1787430811.952330:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836231936:12345-192.168.202.25@tcp:101:cat.0 00000100:00080000:0.0:1787430811.952636:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787430811.952758:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430811.952790:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2f294ee/0x4dbb683ba6a9497f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a2d expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430811.952816:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a0797, atime: 0x6a8a0796, ctime: 0x6a8a0797, blocks: 0x8 00010000:00010000:1.0:1787430811.952838:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=273s v=(0 0) 00010000:00010000:1.0:1787430811.952843:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430811.952853:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2f294ee/0x4dbb683ba6a9497f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a2d expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.952871:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2f294ee/0x4dbb683ba6a9497f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a2d expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430811.952885:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031400, rc 0) 00000100:00100000:1.0:1787430811.952943:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836231936:12345-192.168.202.25@tcp:101:cat.0 Request processed in 613us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430811.952949:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:0.0:1787430811.957706:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430811.957813:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232064 00000100:00100000:2.0:1787430811.957823:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232064 00002000:00100000:2.0:1787430811.957870:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8e2b048fe300 x1874256836232064/t0(0) o3->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:32/0 lens 488/0 e 0 to 0 dl 1787430822 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430811.957882:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b048fe300 with x1874256836232064 ext(0->4095) 00002000:00010000:2.0:1787430811.957887:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b048fe300 00000100:00100000:2.0:1787430811.957920:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1787430811.957930:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836232064:12345-192.168.202.25@tcp:3:cat.0 00000100:00100000:2.0:1787430811.958123:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836232064:12345-192.168.202.25@tcp:3:cat.0 Request processed in 193us (426us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787430811.958130:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00002000:00100000:2.0:1787430811.958137:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8e2b048fe300 x1874256836232064/t0(0) o3->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:32/0 lens 488/4536 e 0 to 0 dl 1787430822 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430811.958155:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b048fe300 with x1874256836232064 ext(0->4095) 00002000:00010000:2.0:1787430811.958158:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b048fe300 00000001:00080000:1.0:1787430812.422312:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787430812.422333:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:1.0:1787430812.672079:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430813.441000:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787430813.441059:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0493aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847813248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430813.441128:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430813.441186:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847813120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430813.441271:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847813248 00000100:00100000:1.0:1787430813.441280:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847813248 00000100:00100000:3.0:1787430813.441285:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430813.441388:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847813120 00000100:00100000:1.0:1787430813.441398:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847813120 00000100:00100000:1.0:1787430813.441420:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430813.441428:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847813248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430813.441467:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787430813.441515:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847813248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430813.441533:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430813.441548:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787430813.441553:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847813120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430813.441560:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787430813.441581:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847813120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430813.441585:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1787430813.441596:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430813.441647:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0493aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847813248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430813.441656:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847813120:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1787430813.444898:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787430813.444925:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2b03f5d480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787430813.444930:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2b03b94000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2c12bbb6c0 00000020:00080000:1.0:1787430813.444933:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2b03b94100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b035ade00 00000020:00080000:1.0:1787430813.444949:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1787430813.445029:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430813.445040:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430813.445048:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430813.445054:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430813.445072:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430813.445080:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430813.445097:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e2b03b29500) 00010000:00010000:2.0:1787430813.445100:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430813.445112:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430813.445117:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a948fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787430813.445158:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787430813.445218:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787430813.448483:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847813376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430813.448560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430813.449643:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847813376 00000100:00100000:2.0:1787430813.449658:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847813376 00000100:00100000:2.0:1787430813.449723:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787430813.449732:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847813376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787430813.449883:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787430813.449973:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847813376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 241us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430813.449982:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787430813.454119:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847813376:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1787430813.456817:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787430813.456830:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1787430813.695962:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430814.717902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430814.717963:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430814.718005:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430814.718038:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430814.718057:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430814.718086:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430814.718101:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232704 00000100:00100000:0.0:1787430814.718110:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430814.718113:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232704 00000100:00100000:0.0:1787430814.718174:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232448 00000100:00100000:3.0:1787430814.718177:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232576 00000100:00100000:0.0:1787430814.718180:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232448 00000100:00100000:3.0:1787430814.718183:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232576 00000100:00100000:3.0:1787430814.718219:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:0.0:1787430814.718224:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232960 00000100:00100000:0.0:1787430814.718229:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232960 00000100:00100000:3.0:1787430814.718232:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836232704:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430814.718255:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232320 00000100:00100000:0.0:1787430814.718259:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232320 00000100:00100000:0.0:1787430814.718277:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232832 00000100:00100000:0.0:1787430814.718280:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232832 00000100:00100000:0.0:1787430814.718297:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00100000:0.0:1787430814.718307:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836232448:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430814.718312:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836232704:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430814.718334:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:0.0:1787430814.718358:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836232448:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430814.718366:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:0.0:1787430814.718370:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00100000:3.0:1787430814.718378:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836232576:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430814.718392:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 212 00000100:00100000:0.0:1787430814.718401:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836232960:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430814.718411:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2401:x1874256836232576:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430814.718421:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:3.0:1787430814.718446:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 213 00000100:00100000:3.0:1787430814.718454:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2401:x1874256836232320:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430814.718481:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2401:x1874256836232320:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430814.718487:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 213 00000100:00100000:0.0:1787430814.718494:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836232960:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 93us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430814.718503:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 214 00000100:00100000:3.0:1787430814.718510:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836232832:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430814.718525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 212 00000100:00100000:3.0:1787430814.718547:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836232832:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430814.718563:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 214 00000100:00100000:1.0:1787430814.719039:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836232192 00000100:00100000:1.0:1787430814.719045:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836232192 00000100:00100000:1.0:1787430814.719088:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 364 00000100:00100000:1.0:1787430814.719103:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836232192:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430814.719196:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836232192:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 94us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430814.719203:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 364 00000100:00080000:1.0:1787430814.719261:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430814.719266:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430814.719268:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430814.719270:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787430814.720837:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430815.743800:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430816.000137:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430816.000163:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847813504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430816.000239:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000432:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847813632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430816.000460:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000479:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0493aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847814144:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.000502:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000532:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847814656:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.000557:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000573:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847815168:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.000591:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000630:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787430816.000636:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847813760:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.000662:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000682:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847814272:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.000698:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000711:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847814784:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.000853:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.000891:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847813632 00000100:00100000:1.0:1787430816.000898:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847813632 00000100:00100000:1.0:1787430816.000950:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787430816.000960:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847813632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787430816.000992:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430816.001035:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847813632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.001041:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787430816.001066:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814144 00000100:00100000:1.0:1787430816.001070:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814144 00000100:00100000:2.0:1787430816.001153:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847814016:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.001184:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430816.001204:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847814528:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.001224:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430816.001252:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847815040:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.001271:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430816.001288:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787430816.001293:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847813888:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.001311:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430816.007470:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847814400:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.007556:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.012436:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814272 00000100:00100000:1.0:1787430816.012453:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814272 00000100:00100000:1.0:1787430816.012622:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814784 00000100:00100000:1.0:1787430816.012626:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814784 00000100:00100000:1.0:1787430816.012646:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847813888 00000100:00100000:1.0:1787430816.012648:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847813888 00000100:00100000:1.0:1787430816.012667:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787430816.012676:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847814144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.012826:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847814144:12345-0@lo:400:kworker.0 Request processed in 150us (12321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.012833:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787430816.012853:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787430816.012859:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847814272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.012886:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847814272:12345-0@lo:400:kworker.0 Request processed in 28us (12187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.012891:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787430816.012901:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787430816.012919:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847814784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.012943:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847814784:12345-0@lo:400:kworker.0 Request processed in 25us (12199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.012949:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787430816.012958:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787430816.012963:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847813888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.012987:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1874256847813888:12345-0@lo:400:kworker.0 Request processed in 24us (11675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.012991:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787430816.013014:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814656 00000100:00100000:1.0:1787430816.013017:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814656 00000100:00100000:1.0:1787430816.013041:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815168 00000100:00100000:1.0:1787430816.013044:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815168 00000100:00100000:1.0:1787430816.013054:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814528 00000100:00100000:1.0:1787430816.013056:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814528 00000100:00100000:1.0:1787430816.013065:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815040 00000100:00100000:1.0:1787430816.013067:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815040 00000100:00100000:1.0:1787430816.013077:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430816.013082:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847814656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.013314:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847814656:12345-0@lo:400:kworker.0 Request processed in 231us (12756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.013321:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430816.013346:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787430816.013352:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847815168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.013381:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847815168:12345-0@lo:400:kworker.0 Request processed in 30us (12789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.013387:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787430816.013405:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787430816.013410:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847814528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.013441:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847814528:12345-0@lo:400:kworker.0 Request processed in 31us (12216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.013447:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787430816.013459:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787430816.013465:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847815040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.013492:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847815040:12345-0@lo:400:kworker.0 Request processed in 27us (12219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.013498:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787430816.013628:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847813760 00000100:00100000:1.0:1787430816.013633:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847813760 00000100:00100000:1.0:1787430816.013663:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787430816.013669:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847813760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.013699:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847813760:12345-0@lo:400:kworker.0 Request processed in 31us (13036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.013705:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:1.0:1787430816.013812:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430816.013818:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430816.013820:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430816.013858:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847815296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430816.013895:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430816.013972:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847813760:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.013989:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847814272:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.014001:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847814784:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.014034:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847813632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430816.014045:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0493aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847814144:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.014055:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787430816.014060:0:3629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b03d9d180, transno 4294967311 00000004:00080000:1.0:1787430816.014070:0:3629:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1787430816.014248:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847814912:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430816.014309:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847814528:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014319:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847815040:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014355:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1874256847813888:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014380:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847813504 00000100:00100000:2.0:1787430816.014384:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847813504 00000100:00100000:2.0:1787430816.014414:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814016 00000100:00100000:2.0:1787430816.014417:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814016 00000100:00100000:2.0:1787430816.014431:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787430816.014438:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847813504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787430816.014463:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787430816.014503:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847813504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (14263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430816.014509:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787430816.014541:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787430816.014547:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847814016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014580:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847814016:12345-0@lo:400:kworker.0 Request processed in 33us (13395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430816.014593:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787430816.014635:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814400 00000100:00100000:2.0:1787430816.014638:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814400 00000100:00100000:2.0:1787430816.014664:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847814912 00000100:00100000:2.0:1787430816.014667:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847814912 00000100:00100000:2.0:1787430816.014683:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787430816.014688:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847814400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014718:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847814400:12345-0@lo:400:kworker.0 Request processed in 30us (7163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430816.014724:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787430816.014736:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787430816.014753:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847814912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014778:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847814912:12345-0@lo:400:kworker.0 Request processed in 37us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430816.014784:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1787430816.014806:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430816.014826:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847813504:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787430816.014851:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03eb7b80 x1874256847814400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430816.014862:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847814400:0@lo:400:kworker.0 00010000:00080000:2.0:1787430816.014872:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03dd6300 x1874256847814912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430816.014880:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847814912:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014889:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847814016:0@lo:400:kworker.0 00000100:00100000:2.0:1787430816.014941:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815296 00000100:00100000:2.0:1787430816.014945:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815296 00000100:00100000:2.0:1787430816.014970:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787430816.014978:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847815296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430816.014991:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430816.015028:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847815296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430816.015034:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787430816.015407:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847814656:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.028445:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787430816.028471:0:3629:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1787430816.028494:0:3629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b048fc700, transno 4294967305 00000100:00100000:1.0:1787430816.028513:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847815168:0@lo:400:kworker.0 00000100:00100000:1.0:1787430816.029308:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847815296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787430816.768271:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430817.792742:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430818.561144:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847815424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430818.561213:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430818.561284:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815424 00000100:00100000:2.0:1787430818.561293:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815424 00000100:00100000:2.0:1787430818.561362:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787430818.561373:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847815424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430818.561414:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787430818.561483:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847815424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430818.561489:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1787430818.561512:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430818.561547:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847815424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430818.562912:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847815552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430818.562967:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430818.563045:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815552 00000100:00100000:0.0:1787430818.563052:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815552 00000100:00100000:0.0:1787430818.563095:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787430818.563103:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847815552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787430818.563132:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787430818.563223:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847815680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430818.563252:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430818.563284:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815680 00000100:00100000:3.0:1787430818.563288:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815680 00000100:00100000:3.0:1787430818.563334:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787430818.563341:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847815680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430818.563355:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787430818.563402:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847815680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430818.563409:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1787430818.563428:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430818.563470:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847815680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430818.563906:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847815552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 802us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430818.563913:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787430818.568447:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847815552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787430818.816936:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430819.547682:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430819.552262:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836233088 00000100:00100000:2.0:1787430819.552307:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836233088 00000100:00100000:2.0:1787430819.552404:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00100000:2.0:1787430819.552421:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:11063:x1874256836233088:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787430819.552558:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:11063:x1874256836233088:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 142us (4889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430819.552567:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00080000:3.0:1787430819.553123:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430819.554312:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430819.554407:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836233216 00000100:00100000:2.0:1787430819.554417:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836233216 00000100:00100000:2.0:1787430819.554482:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 147 00000100:00100000:2.0:1787430819.554492:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:11063:x1874256836233216:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787430819.554592:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:11063:x1874256836233216:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430819.554625:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 147 00000100:00080000:3.0:1787430819.554791:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430819.556414:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430819.556507:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836233472 00000100:00100000:1.0:1787430819.556517:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836233472 00000100:00100000:1.0:1787430819.556582:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:1.0:1787430819.556594:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:11063:x1874256836233472:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787430819.556848:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:11063:x1874256836233472:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 255us (441us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787430819.556855:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000001:00080000:2.0:1787430819.566735:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787430819.566756:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787430819.567199:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787430819.567213:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787430819.854825:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430819.854902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430819.854934:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430819.854959:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430819.854961:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836233600 00000100:00100000:2.0:1787430819.854972:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836233600 00000100:00100000:0.0:1787430819.854974:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430819.854990:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430819.855014:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430819.855031:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 366 00000100:00100000:0.0:1787430819.855036:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836234112 00000100:00100000:0.0:1787430819.855040:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836234112 00000100:00100000:2.0:1787430819.855054:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836233600:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430819.855081:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836233984 00000100:00100000:0.0:1787430819.855083:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836233984 00000100:00100000:0.0:1787430819.855104:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:0.0:1787430819.855113:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836234112:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430819.855143:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836233600:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430819.855143:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836234112:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430819.855152:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 366 00000100:00100000:0.0:1787430819.855156:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:0.0:1787430819.855169:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:0.0:1787430819.855175:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836233984:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430819.855189:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836233856 00000100:00100000:2.0:1787430819.855193:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836233856 00000100:00100000:0.0:1787430819.855199:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836233984:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430819.855205:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:2.0:1787430819.855230:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836234368 00000100:00100000:0.0:1787430819.855232:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836233728 00000100:00100000:2.0:1787430819.855234:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836234368 00000100:00100000:0.0:1787430819.855234:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836233728 00000100:00100000:0.0:1787430819.855262:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836234240 00000100:00100000:0.0:1787430819.855265:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836234240 00010000:00010000:3.0:1787430819.855314:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430819.855486:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00100000:2.0:1787430819.855494:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836233856:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430819.855530:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836233856:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 37us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430819.855536:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00100000:2.0:1787430819.855548:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 222 00000100:00100000:2.0:1787430819.855555:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2400:x1874256836233728:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430819.855584:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2400:x1874256836233728:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430819.855589:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 222 00000100:00100000:2.0:1787430819.855620:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 223 00000100:00100000:2.0:1787430819.855627:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836234368:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430819.855650:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836234368:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430819.855656:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 223 00000100:00100000:2.0:1787430819.855668:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 224 00000100:00100000:2.0:1787430819.855674:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836234240:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430819.855695:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836234240:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430819.855700:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 224 00000100:00080000:2.0:1787430819.863102:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430819.863115:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430819.863119:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430819.863122:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430820.148892:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430820.149092:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836234496 00000100:00100000:0.0:1787430820.149106:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836234496 00000100:00100000:0.0:1787430820.149178:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 148 00000100:00100000:0.0:1787430820.149190:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:11868:x1874256836234496:12345-192.168.202.25@tcp:101:lsof.0 00010000:00010000:0.0:1787430820.149276:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430820.149311:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a34 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.149393:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.149408:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.149421:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430820.149496:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430820.149515:0:8819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430820.149559:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.149587:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 7 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.149654:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 6 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.149663:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:0.0:1787430820.149671:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430820.149675:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175200, rc 0) 00000100:00100000:0.0:1787430820.149888:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:11868:x1874256836234496:12345-192.168.202.25@tcp:101:lsof.0 Request processed in 699us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430820.149896:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 148 00010000:00010000:1.0:1787430820.863840:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430821.119803:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430821.119830:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847815936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430821.119914:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430821.119995:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847816064:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120157:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430821.120192:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847816576:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120218:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430821.120235:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847817088:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120257:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430821.120303:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816576 00000100:00100000:1.0:1787430821.120316:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816576 00000100:00100000:1.0:1787430821.120380:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787430821.120381:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787430821.120391:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847816448:0@lo:400:kworker.0 00000100:00100000:1.0:1787430821.120398:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847816576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120429:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430821.120451:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847816960:0@lo:400:kworker.0 00000100:00100000:1.0:1787430821.120472:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847816576:12345-0@lo:400:kworker.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430821.120481:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430821.120498:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847817472:0@lo:400:kworker.0 00000100:00100000:1.0:1787430821.120504:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787430821.120524:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430821.120538:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815936 00000100:00100000:1.0:1787430821.120543:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815936 00000100:00100000:2.0:1787430821.120563:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847816576:0@lo:400:kworker.0 00000100:00100000:1.0:1787430821.120588:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787430821.120597:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847815936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430821.120627:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817088 00000100:00100000:2.0:1787430821.120633:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817088 00002000:00000024:1.0:1787430821.120650:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430821.120662:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816960 00000100:00100000:2.0:1787430821.120666:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816960 00000100:00100000:2.0:1787430821.120686:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817472 00000100:00100000:2.0:1787430821.120689:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817472 00000100:00100000:2.0:1787430821.120710:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787430821.120712:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847815936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430821.120720:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847817088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430821.120722:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1787430821.120753:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430821.120758:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430821.120773:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847817088:12345-0@lo:400:kworker.0 Request processed in 54us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430821.120781:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787430821.120796:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787430821.120802:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847816960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120830:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847816960:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430821.120835:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787430821.120846:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787430821.120852:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847817472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120876:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847817472:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430821.120882:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787430821.120910:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847816960:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120919:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847817472:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120928:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847817088:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.120943:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847815936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430821.121134:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847815808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430821.121175:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430821.121181:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816064 00000100:00100000:0.0:1787430821.121187:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816064 00000100:00100000:3.0:1787430821.121212:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847816320:0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121229:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787430821.121239:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847816064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430821.121249:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430821.121275:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847816832:0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121296:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847816064:12345-0@lo:400:kworker.0 Request processed in 58us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.121304:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787430821.121318:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430821.121338:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847815808 00000100:00100000:3.0:1787430821.121344:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847817344:0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121344:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847815808 00000100:00100000:0.0:1787430821.121366:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816320 00000100:00100000:0.0:1787430821.121370:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816320 00000100:00100000:3.0:1787430821.121374:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430821.121390:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787430821.121397:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847815808:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430821.121399:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787430821.121409:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847816192:0@lo:400:kworker.0 00000004:00000024:0.0:1787430821.121431:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430821.121438:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430821.121462:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847816704:0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121475:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847815808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.121482:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787430821.121491:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430821.121499:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787430821.121513:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847817216:0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121515:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847816320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430821.121547:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430821.121558:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847816320:12345-0@lo:400:kworker.0 Request processed in 51us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.121564:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787430821.121583:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847815808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430821.121597:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847816320:0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121633:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816448 00000100:00100000:0.0:1787430821.121638:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816448 00000100:00100000:3.0:1787430821.121647:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430821.121657:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847817600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430821.121660:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816832 00000100:00100000:0.0:1787430821.121664:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816832 00000100:00100000:0.0:1787430821.121684:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817344 00000100:00100000:0.0:1787430821.121687:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817344 00000100:00100000:0.0:1787430821.121698:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816192 00000100:00100000:3.0:1787430821.121702:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430821.121703:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816192 00000100:00100000:0.0:1787430821.121720:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847816704 00000100:00100000:0.0:1787430821.121724:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847816704 00000100:00100000:0.0:1787430821.121738:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817216 00000100:00100000:0.0:1787430821.121741:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817216 00000100:00100000:3.0:1787430821.121745:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817600 00000100:00100000:3.0:1787430821.121751:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817600 00000100:00100000:0.0:1787430821.121758:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787430821.121767:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847816448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430821.121786:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787430821.121804:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847816448:12345-0@lo:400:kworker.0 Request processed in 39us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.121811:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787430821.121824:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787430821.121830:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847816832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121871:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847816832:12345-0@lo:400:kworker.0 Request processed in 41us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.121877:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787430821.121889:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787430821.121895:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847817344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121918:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847817344:12345-0@lo:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.121924:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787430821.121933:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787430821.121939:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847816192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.121962:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847816192:12345-0@lo:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.121967:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787430821.121977:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787430821.121982:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847816704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.122004:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847816704:12345-0@lo:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.122010:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787430821.122021:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787430821.122027:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847817216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.122052:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847817216:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.122058:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787430821.122919:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847817600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430821.122953:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430821.123009:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847817600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1215us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430821.123045:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787430821.123098:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847816192:0@lo:400:kworker.0 00000100:00100000:3.0:1787430821.123113:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847816704:0@lo:400:kworker.0 00000100:00100000:3.0:1787430821.123127:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847817216:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.123162:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847816448:0@lo:400:kworker.0 00000100:00080000:1.0:1787430821.123195:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430821.123200:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787430821.124360:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b049a4700 x1874256847816832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430821.124378:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847816832:0@lo:400:kworker.0 00010000:00080000:3.0:1787430821.124398:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b049a4000 x1874256847817344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430821.124406:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847817344:0@lo:400:kworker.0 00000100:00100000:2.0:1787430821.129926:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847816064:0@lo:400:kworker.0 00000100:00100000:0.0:1787430821.130951:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847817600:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787430821.313261:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787430821.888633:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430821.888646:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430821.888789:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00010000:00010000:2.0:1787430821.888793:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787430821.888797:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787430822.912766:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430823.679892:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847817728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430823.679978:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430823.680118:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817728 00000100:00100000:2.0:1787430823.680128:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817728 00000100:00100000:2.0:1787430823.680185:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787430823.680189:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430823.680198:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847817856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430823.680212:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847817728:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430823.680227:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787430823.680248:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:3.0:1787430823.680290:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430823.680309:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847817728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430823.680316:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787430823.680332:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847817728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430823.680930:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817856 00000100:00100000:1.0:1787430823.680936:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817856 00000100:00100000:2.0:1787430823.680972:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430823.680973:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787430823.680980:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847817856:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430823.680982:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847817984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430823.681014:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1787430823.681021:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787430823.681072:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847817856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430823.681079:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787430823.681096:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847817984 00000100:00100000:3.0:1787430823.681100:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847817984 00000100:00100000:3.0:1787430823.681147:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787430823.681154:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847817984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430823.681174:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787430823.681210:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847817984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430823.681217:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787430823.681249:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847817984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430823.681358:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847817856:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787430823.681765:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787430823.935931:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430824.959936:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430824.965767:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430824.965803:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430824.965823:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430824.965851:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430824.965874:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430824.965894:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430824.965932:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430824.965963:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836234752 00000100:00100000:3.0:1787430824.965972:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836234752 00000100:00100000:3.0:1787430824.966028:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836235264 00000100:00100000:3.0:1787430824.966031:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836235264 00000100:00100000:3.0:1787430824.966051:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836234880 00000100:00100000:3.0:1787430824.966054:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836234880 00000100:00100000:3.0:1787430824.966066:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836235392 00000100:00100000:3.0:1787430824.966069:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836235392 00000100:00100000:3.0:1787430824.966085:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00100000:3.0:1787430824.966095:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2400:x1874256836234752:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430824.966170:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2400:x1874256836234752:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 76us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430824.966178:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00100000:3.0:1787430824.966196:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 232 00000100:00100000:3.0:1787430824.966218:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2400:x1874256836235264:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430824.966259:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2400:x1874256836235264:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430824.966265:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 232 00000100:00100000:3.0:1787430824.966278:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 233 00000100:00100000:3.0:1787430824.966285:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836234880:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430824.966310:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836234880:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430824.966316:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 233 00000100:00100000:3.0:1787430824.966328:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 234 00000100:00100000:3.0:1787430824.966334:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836235392:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430824.966357:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836235392:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430824.966375:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 234 00000100:00100000:3.0:1787430824.966396:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836235008 00000100:00100000:3.0:1787430824.966401:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836235008 00000100:00100000:3.0:1787430824.966430:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836235136 00000100:00100000:3.0:1787430824.966445:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836235136 00000100:00100000:3.0:1787430824.966469:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:3.0:1787430824.966477:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836235008:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430824.966503:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836235008:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430824.966510:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:3.0:1787430824.966522:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:3.0:1787430824.966536:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836235136:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430824.966563:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836235136:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430824.966569:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:3.0:1787430824.966593:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836234624 00000100:00100000:3.0:1787430824.966597:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836234624 00000100:00100000:3.0:1787430824.966644:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 368 00000100:00100000:3.0:1787430824.966651:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836234624:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430824.966676:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836234624:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430824.966682:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 368 00000100:00080000:3.0:1787430824.966715:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430824.966719:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430824.966722:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430824.966723:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787430825.985431:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430826.049134:0:14482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:33:44 (1787430824) 00000100:00100000:0.0:1787430826.240095:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847818112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430826.240183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.240491:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847818368:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.240530:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.240553:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847818880:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.240574:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.240593:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847819392:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.240663:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.240686:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787430826.240691:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847818240:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.240715:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.240733:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847818752:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.240756:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.240774:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847819264:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.240797:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.240827:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847818368 00000100:00100000:2.0:1787430826.240835:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847818368 00000100:00100000:2.0:1787430826.240894:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847818880 00000100:00100000:2.0:1787430826.240898:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847818880 00000100:00100000:2.0:1787430826.240924:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819392 00000100:00100000:2.0:1787430826.240927:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819392 00000100:00100000:2.0:1787430826.240951:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787430826.240960:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847818368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.241012:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847818368:12345-0@lo:400:kworker.0 Request processed in 53us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.241019:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787430826.241038:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787430826.241044:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.241069:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847818880:12345-0@lo:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.241075:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787430826.241365:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787430826.241374:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847819392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.241485:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874256847819392:12345-0@lo:400:kworker.0 Request processed in 113us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.241491:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787430826.241557:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847818240 00000100:00100000:2.0:1787430826.241561:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847818240 00000100:00100000:2.0:1787430826.241590:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787430826.241597:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847818240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.241701:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847818240:12345-0@lo:400:kworker.0 Request processed in 50us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.241708:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787430826.241740:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847818752 00000100:00100000:2.0:1787430826.241750:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847818752 00000100:00100000:2.0:1787430826.241785:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787430826.241792:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847818752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.241825:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847818752:12345-0@lo:400:kworker.0 Request processed in 34us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.241832:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787430826.241850:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819264 00000100:00100000:2.0:1787430826.241854:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819264 00000100:00100000:2.0:1787430826.241880:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787430826.241887:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847819264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.241919:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847819264:12345-0@lo:400:kworker.0 Request processed in 33us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.241925:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787430826.241945:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430826.241951:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430826.241977:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847818496:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.242008:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.242030:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847819008:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.242052:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.242068:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847819520:0@lo:400:kworker.0 00000100:00100000:0.0:1787430826.242213:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847819776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430826.242256:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430826.242289:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847818496 00000100:00100000:0.0:1787430826.242293:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847818496 00000100:00100000:0.0:1787430826.242319:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787430826.242325:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847818496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430826.242358:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847818496:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430826.242363:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787430826.242398:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847818112 00000100:00100000:0.0:1787430826.242401:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847818112 00000100:00100000:0.0:1787430826.242430:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819776 00000100:00100000:0.0:1787430826.242432:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819776 00000100:00100000:0.0:1787430826.242446:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787430826.242452:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847818112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430826.242479:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430826.242512:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847818112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430826.242518:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787430826.242529:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787430826.242536:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847819776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787430826.242556:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430826.242586:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847819776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430826.242592:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1787430826.242625:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430826.242683:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847819776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430826.243507:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.243552:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847818496:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.243565:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787430826.243573:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847818624:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.243618:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.243634:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847819136:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.244170:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.244194:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847819648:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.244215:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430826.244294:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819136 00000100:00100000:2.0:1787430826.244299:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819136 00000100:00100000:2.0:1787430826.244348:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819648 00000100:00100000:2.0:1787430826.244351:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819648 00000100:00100000:2.0:1787430826.244371:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787430826.244952:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847819136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.245017:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847819136:12345-0@lo:400:kworker.0 Request processed in 638us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.245025:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787430826.245046:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787430826.245055:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847819648:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787430826.245218:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430826.245228:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430826.245248:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847819904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430826.245288:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430826.245322:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819904 00000100:00100000:0.0:1787430826.245326:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819904 00000100:00100000:0.0:1787430826.245358:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787430826.245364:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847819904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787430826.245421:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787430826.245456:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847819904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430826.245463:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787430826.245499:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847819904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430826.245708:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847819648:12345-0@lo:400:kworker.0 Request processed in 30us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.245771:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787430826.245801:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819008 00000100:00100000:2.0:1787430826.245806:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819008 00000100:00100000:2.0:1787430826.245840:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847819520 00000100:00100000:2.0:1787430826.245844:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847819520 00000100:00100000:2.0:1787430826.245862:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847818624 00000100:00100000:2.0:1787430826.245865:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847818624 00000100:00100000:2.0:1787430826.245879:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787430826.245886:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847819008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.245920:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847819008:12345-0@lo:400:kworker.0 Request processed in 35us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.245936:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787430826.245948:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787430826.245953:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847819520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.245979:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847819520:12345-0@lo:400:kworker.0 Request processed in 26us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.245984:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787430826.245994:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787430826.246000:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847818624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.246025:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847818624:12345-0@lo:400:kworker.0 Request processed in 25us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430826.246031:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787430826.246078:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847818112:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787430826.246177:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430826.247328:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847818240:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.247344:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847818752:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.247356:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847819264:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.247367:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847818368:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.248279:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847818880:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.248309:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1874256847819392:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.248366:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847818624:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.248376:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847819136:0@lo:400:kworker.0 00000100:00100000:2.0:1787430826.248752:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847819648:0@lo:400:kworker.0 00010000:00080000:2.0:1787430826.248782:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03e57100 x1874256847819008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430826.248793:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847819008:0@lo:400:kworker.0 00010000:00080000:2.0:1787430826.248805:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03e55880 x1874256847819520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430826.248814:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847819520:0@lo:400:kworker.0 00010000:00010000:1.0:1787430827.014792:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430827.953045:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430827.953263:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836235648 00000100:00100000:2.0:1787430827.953276:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836235648 00000100:00100000:2.0:1787430827.953369:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 149 00000100:00100000:2.0:1787430827.953384:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:12136:x1874256836235648:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430827.953409:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.953435:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94994 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a3b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953714:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953730:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953745:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953819:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953828:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953854:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787430827.953909:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787430827.953957:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953967:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.953975:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430827.953985:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787430827.954085:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954094:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954102:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954108:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430827.954113:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954122:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954136:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2b03b33e00) 00010000:00010000:2.0:1787430827.954139:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.954151:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954158:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a9499b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954173:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954181:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954187:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954192:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430827.954196:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954224:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954233:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e2b03b29800) 00010000:00010000:2.0:1787430827.954235:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.954238:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.954245:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a949a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.955929:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94994 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a3b expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.955981:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a3b expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.955990:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:2.0:1787430827.955993:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.955996:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02600, rc 0) 00000100:00100000:2.0:1787430827.956092:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:12136:x1874256836235648:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 2712us (3057us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787430827.956101:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 149 00000100:00100000:2.0:1787430827.979897:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430827.980056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430827.980356:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836235904 00000100:00100000:0.0:1787430827.980366:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836235904 00000100:00100000:0.0:1787430827.980437:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1787430827.980449:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11440c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:2400:x1874256836235904:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430827.980467:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430827.980494:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a3b expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.980529:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:0.0:1787430827.980534:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430827.980586:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11440c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:2400:x1874256836235904:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 139us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.980629:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:3.0:1787430827.991918:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836235776 00000100:00100000:3.0:1787430827.991935:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836235776 00000100:00100000:0.0:1787430827.992084:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 150 00000100:00100000:0.0:1787430827.992095:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:12136:x1874256836235776:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787430827.992228:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:12136:x1874256836235776:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 134us (12341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.992236:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 150 00000100:00100000:2.0:1787430828.003249:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430828.003359:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236032 00000100:00100000:0.0:1787430828.003369:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236032 00000100:00100000:0.0:1787430828.003453:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 151 00000100:00100000:0.0:1787430828.003473:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:12136:x1874256836236032:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787430828.003597:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:12136:x1874256836236032:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 126us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.003634:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 151 00000100:00080000:1.0:1787430828.004058:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787430828.031985:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430828.032490:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430828.032499:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430828.033151:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787430828.033164:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787430828.482767:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787430828.800830:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847820160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430828.800905:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430828.800987:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430828.800994:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847820032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430828.801032:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430828.801073:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847820032 00000100:00100000:2.0:1787430828.801081:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847820032 00000100:00100000:2.0:1787430828.801131:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787430828.801142:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847820032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787430828.801180:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787430828.801240:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847820032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430828.801248:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787430828.801310:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847820032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430828.801428:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847820160 00000100:00100000:3.0:1787430828.801433:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847820160 00000100:00100000:3.0:1787430828.801485:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787430828.801493:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847820160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787430828.801514:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787430828.801552:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847820160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430828.801558:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787430828.801651:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847820160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787430828.801737:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430828.802024:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847820288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430828.802056:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430828.803022:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847820288 00000100:00100000:0.0:1787430828.803032:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847820288 00000100:00100000:0.0:1787430828.803098:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787430828.803123:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847820288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430828.803140:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787430828.803200:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847820288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.803219:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1787430828.803299:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430828.803382:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847820288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787430829.056450:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430830.078733:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.078786:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.078848:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.078902:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430830.078904:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236416 00000100:00100000:2.0:1787430830.078921:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236416 00000100:00100000:3.0:1787430830.078943:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236544 00000100:00100000:3.0:1787430830.078953:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236544 00000100:00100000:2.0:1787430830.079045:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236288 00000100:00100000:3.0:1787430830.079051:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:2.0:1787430830.079053:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236288 00000100:00100000:3.0:1787430830.079074:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836236544:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430830.079104:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:2.0:1787430830.079117:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836236416:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430830.079179:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836236544:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 113us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430830.079207:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:2.0:1787430830.079236:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2399:x1874256836236416:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 117us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.079248:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:2.0:1787430830.079272:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 242 00000100:00100000:2.0:1787430830.079283:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:2399:x1874256836236288:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430830.079325:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:2399:x1874256836236288:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 46us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.079331:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 242 00000100:00080000:2.0:1787430830.079356:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430830.079360:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430830.079363:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430830.079648:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236160 00000100:00100000:0.0:1787430830.079663:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236160 00000100:00100000:0.0:1787430830.079719:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 370 00000100:00100000:0.0:1787430830.079728:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836236160:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430830.079770:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2399:x1874256836236160:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 44us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430830.079778:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 370 00010000:00010000:3.0:1787430830.080130:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430830.097450:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.097579:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.097653:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.097703:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236928 00000100:00100000:3.0:1787430830.097714:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236928 00000100:00100000:3.0:1787430830.097775:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236800 00000100:00100000:3.0:1787430830.097779:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236800 00000100:00100000:3.0:1787430830.097803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 243 00000100:00100000:3.0:1787430830.097814:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836236928:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430830.097904:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836236928:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430830.097912:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 243 00000100:00100000:3.0:1787430830.097930:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 244 00000100:00100000:3.0:1787430830.097937:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2400:x1874256836236800:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430830.097992:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2400:x1874256836236800:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 55us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430830.097999:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 244 00000100:00080000:3.0:1787430830.098138:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430830.098143:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430830.103305:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836236672 00000100:00100000:2.0:1787430830.103328:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836236672 00000100:00100000:2.0:1787430830.103461:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:2.0:1787430830.103476:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2398:x1874256836236672:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:2.0:1787430830.103525:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a94351 00000100:00080000:2.0:1787430830.103537:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8e2c0782d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430830.103593:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967305 00000100:00080000:1.0:1787430830.103788:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430830.104159:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+2:2398:x1874256836236672:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 687us (6720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.104169:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00010000:00010000:2.0:1787430830.104209:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430830.464581:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430830.465204:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836237056 00000100:00100000:2.0:1787430830.465217:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836237056 00000100:00100000:2.0:1787430830.465281:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 152 00000100:00100000:2.0:1787430830.465293:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:12177:x1874256836237056:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430830.465314:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430830.465335:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a42 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465396:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465409:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465420:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465436:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465443:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465460:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465503:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465509:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465515:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465521:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430830.465525:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465533:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465545:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:2.0:1787430830.465547:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430830.465551:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465557:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465568:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465573:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465586:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465590:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430830.465593:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465634:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465644:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e2b03b29800) 00010000:00010000:2.0:1787430830.465647:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430830.465650:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465655:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465687:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a42 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465697:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:2.0:1787430830.465699:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430830.465702:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a42 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.465710:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02600, rc 0) 00000100:00100000:2.0:1787430830.465781:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:12177:x1874256836237056:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 490us (1208us total) trans 0 rc 301/301 00000100:00100000:2.0:1787430830.465798:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 152 00000100:00100000:0.0:1787430830.479084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430830.479164:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836237312 00000100:00100000:1.0:1787430830.479174:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836237312 00000100:00100000:1.0:1787430830.479257:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00100000:1.0:1787430830.479268:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:12177:x1874256836237312:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:1.0:1787430830.479329:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430830.479357:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a9430b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138866 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430830.479377:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:1.0:1787430830.479383:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430830.479450:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430830.479465:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 5 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430830.479474:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430830.479511:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 5 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430830.479525:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 5 pid: 8819 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430830.479557:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847820416:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430830.479681:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430830.482646:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847820416:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430830.482683:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430830.485909:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430830.486057:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836237440 00000100:00100000:2.0:1787430830.486068:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836237440 00010000:00010000:2.0:1787430830.486110:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 6 pid: 8819 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430830.486153:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:2.0:1787430830.486163:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2399:x1874256836237440:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430830.486189:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430830.486208:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 6 pid: 8819 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.486223:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 6 pid: 8819 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.486249:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a9498d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a34 expref: 6 pid: 8819 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.486268:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:2.0:1787430830.486274:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.486284:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.486292:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.486342:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430830.486402:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2399:x1874256836237440:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 238us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.486410:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 79 00010000:00010000:3.0:1787430830.489506:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.489525:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.489553:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.489567:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.489580:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498313:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498338:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498349:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430830.498367:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034a08f7d reply state 000000001d6ad109 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498394:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498401:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:3.0:1787430830.498404:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430830.498408:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787430830.498415:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787430830.498425:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498432:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498439:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498445:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430830.498449:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498459:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498472:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c1847bc00) 00010000:00010000:3.0:1787430830.498475:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430830.498479:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498485:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a949cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430830.498518:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034a08f7d reply state 000000001d6ad109 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498526:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.498533:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e2c132d1500) 00010000:00010000:3.0:1787430830.498535:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430830.498536:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787430830.498666:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:12177:x1874256836237312:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 19395us (19587us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787430830.498675:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00100000:0.0:1787430830.647699:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430830.647839:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836237568 00000100:00100000:2.0:1787430830.647848:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836237568 00000100:00100000:2.0:1787430830.647901:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 154 00000100:00100000:2.0:1787430830.647912:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+15:12186:x1874256836237568:12345-192.168.202.25@tcp:101:lctl.0 00010000:00010000:2.0:1787430830.647937:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430830.647959:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a49 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.648017:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.648031:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.648043:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430830.648087:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787430830.648090:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430830.648111:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.648133:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a49 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.648162:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a49 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.648171:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:2.0:1787430830.648173:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430830.648176:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02400, rc 0) 00000100:00100000:2.0:1787430830.648254:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:12186:x1874256836237568:12345-192.168.202.25@tcp:101:lctl.0 Request processed in 343us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.648262:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 154 00000100:00100000:1.0:1787430830.746448:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430830.746659:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836237696 00000100:00100000:2.0:1787430830.746670:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836237696 00000100:00100000:2.0:1787430830.746735:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:2.0:1787430830.746746:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+16:12192:x1874256836237696:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430830.746767:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430830.746787:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a50 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.746849:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.746875:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.746888:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.746900:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.746919:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.746926:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747153:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94a04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747163:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747180:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430830.747229:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787430830.747234:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430830.747258:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747270:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747277:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747284:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747291:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430830.747295:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747311:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747325:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:2.0:1787430830.747327:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430830.747332:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747338:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a949f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747352:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747358:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747364:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747369:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430830.747373:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747378:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747387:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e2c132d1500) 00010000:00010000:2.0:1787430830.747389:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430830.747392:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747408:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a949fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747435:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a949ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a50 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747448:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a50 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.747455:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430830.747458:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787430830.747460:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03200, rc 0) 00000100:00100000:2.0:1787430830.747533:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:12192:x1874256836237696:12345-192.168.202.25@tcp:101:bash.0 Request processed in 788us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.747541:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:1.0:1787430830.753781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430830.754067:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836237952 00000100:00100000:0.0:1787430830.754077:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836237952 00000100:00100000:0.0:1787430830.754142:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:0.0:1787430830.754153:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:12192:x1874256836237952:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430830.754175:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430830.754215:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94a0b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a57 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.754348:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.754364:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.754377:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.754434:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.754443:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.754451:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787430830.754842:0:10098:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787430830.755450:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755464:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755474:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755512:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755535:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755543:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755549:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430830.755554:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755562:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755575:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430830.755578:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430830.755582:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.755588:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94a12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430830.759471:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dba849ee reply state 000000006e981791 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.759502:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.759512:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430830.759515:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430830.759520:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787430830.765464:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94a0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 20 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.765504:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 19 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.765515:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:2.0:1787430830.765518:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430830.765522:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175200, rc 0) 00000100:00100000:2.0:1787430830.765640:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:12192:x1874256836237952:12345-192.168.202.25@tcp:101:bash.0 Request processed in 11487us (11870us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787430830.765671:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:3.0:1787430830.770680:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430830.771048:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836238080 00000100:00100000:2.0:1787430830.771061:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836238080 00000100:00100000:2.0:1787430830.771111:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:2.0:1787430830.771120:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874256836238080:12345-192.168.202.25@tcp:8:bash.0 00010000:00080000:2.0:1787430830.771156:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:2.0:1787430830.771185:0:8411:0:(genops.c:1385:class_connect()) connect: client 419b0c27-15f9-4e73-995a-bc02788ae1b0, cookie 0x4dbb683ba6a94a2e 00002000:00100000:2.0:1787430830.771226:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 419b0c27-15f9-4e73-995a-bc02788ae1b0/ffff8e2c3f919000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 25255936 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430830.771247:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787430830.771335:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787430830.771365:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f91a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430830.771438:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3637a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2398:x1874256836238080:12345-192.168.202.25@tcp:8:bash.0 Request processed in 317us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.771446:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1787430830.779835:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.783541:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836238208 00000100:00100000:3.0:1787430830.783557:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836238208 00000100:00100000:3.0:1787430830.783725:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:3.0:1787430830.783737:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:0:x1874256836238208:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1787430830.783759:0:11754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430830.783782:0:11754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a5e expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430830.783808:0:11754:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787430830.783828:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:3.0:1787430830.783832:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430830.783842:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 7 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.783896:0:11754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 7 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.783908:0:11754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b800, rc 0) 00000100:00100000:3.0:1787430830.783990:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:0:x1874256836238208:12345-192.168.202.25@tcp:101:bash.0 Request processed in 255us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430830.783997:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:1.0:1787430830.787021:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.787233:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836238336 00000100:00100000:3.0:1787430830.787246:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836238336 00000100:00100000:3.0:1787430830.787317:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:3.0:1787430830.787328:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:12192:x1874256836238336:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1787430830.787346:0:8830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430830.787367:0:8830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a65 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.787403:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 8 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.787412:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430830.787430:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430830.787435:0:8830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 8 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.787471:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 8 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.787500:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 8 pid: 11754 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430830.787513:0:8830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8830:1874256847820544:192.168.202.25@tcp:104: 00000100:00080000:2.0:1787430830.787555:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430830.787640:0:8830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430830.790296:0:8830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8830:1874256847820544:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430830.790338:0:8830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 8 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.790359:0:8830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a600, rc 0) 00000100:00100000:2.0:1787430830.790427:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:12192:x1874256836238336:12345-192.168.202.25@tcp:101:bash.0 Request processed in 3099us (3433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.790436:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:1.0:1787430830.791756:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430830.793425:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836238464 00000100:00100000:0.0:1787430830.793459:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836238464 00010000:00010000:0.0:1787430830.793520:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 8 pid: 11754 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430830.793579:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:0.0:1787430830.793590:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836238464:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430830.793633:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430830.793657:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 8 pid: 11754 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.793672:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 8 pid: 11754 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.793696:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a5e expref: 8 pid: 11754 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.793712:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430830.793716:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430830.793723:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 7 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.793733:0:9495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 7 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430830.793777:0:9495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 7 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430830.793805:0:9495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9495:1874256847820672:192.168.202.25@tcp:105: 00000100:00100000:0.0:1787430830.794157:0:9495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c05349240 going to sleep for 11 seconds 00000100:00100000:1.0:1787430830.807162:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430830.807382:0:9495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9495:1874256847820672:192.168.202.25@tcp:105: 00010000:00010000:0.0:1787430830.807410:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430830.807471:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836238464:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 13882us (15720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430830.807483:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:3.0:1787430830.807758:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836238720 00000100:00100000:3.0:1787430830.807768:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836238720 00000100:00100000:3.0:1787430830.807819:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1787430830.807829:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:12192:x1874256836238720:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:3.0:1787430830.808104:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12192:x1874256836238720:12345-192.168.202.25@tcp:35:bash.0 Request processed in 277us (953us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787430830.808111:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1787430830.973310:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430830.973596:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836238976 00000100:00100000:2.0:1787430830.973662:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836238976 00000100:00100000:2.0:1787430830.973730:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:2.0:1787430830.973742:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12202:x1874256836238976:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430830.973769:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430830.973790:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a6c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430830.974135:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787430830.974251:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94a43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a6c expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.974266:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:2.0:1787430830.974268:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430830.974273:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a6c expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.974287:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02600, rc 0) 00000100:00100000:2.0:1787430830.974405:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12202:x1874256836238976:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 665us (1107us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1787430830.974412:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:0.0:1787430830.995375:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430830.996334:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836239232 00000100:00100000:3.0:1787430830.996349:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836239232 00000100:00100000:3.0:1787430830.996418:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:3.0:1787430830.996430:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12202:x1874256836239232:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430830.997182:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12202:x1874256836239232:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 743us (1807us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787430830.997203:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:0.0:1787430831.096500:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430831.097084:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836239360 00000100:00100000:2.0:1787430831.097096:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836239360 00000100:00100000:2.0:1787430831.097165:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 158 00000100:00100000:2.0:1787430831.097194:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12208:x1874256836239360:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430831.097240:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430831.097262:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a73 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.097336:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94a58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.097351:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.097363:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430831.097407:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787430831.097412:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430831.097430:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.097458:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a73 expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.097477:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a73 expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.097486:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430831.097489:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430831.097493:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02c00, rc 0) 00000100:00100000:2.0:1787430831.097559:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12208:x1874256836239360:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 375us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430831.097566:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 158 00000100:00100000:0.0:1787430831.102352:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000040:00080000:2.0:1787430831.104287:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430831.104298:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787430831.104763:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836239616 00000100:00100000:3.0:1787430831.104778:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836239616 00000100:00100000:3.0:1787430831.104839:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 159 00000100:00100000:3.0:1787430831.104849:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12208:x1874256836239616:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430831.104882:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430831.104902:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94a5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a7a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.105170:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94a66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.105197:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.105214:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430831.105227:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787430831.105341:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94a5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a7a expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.105358:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a7a expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.105366:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:3.0:1787430831.105369:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430831.105372:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8aa00, rc 0) 00000100:00100000:3.0:1787430831.105437:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:12208:x1874256836239616:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 589us (3095us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787430831.105443:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 159 00000040:00080000:2.0:1787430831.106288:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787430831.106308:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787430831.107529:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430831.115827:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.115937:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430831.116147:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836240000 00000100:00100000:2.0:1787430831.116160:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836240000 00000100:00100000:2.0:1787430831.116259:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:2.0:1787430831.116271:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:2400:x1874256836240000:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430831.116292:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430831.116320:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94a66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a7a expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.116491:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:2.0:1787430831.116497:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430831.116568:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:2400:x1874256836240000:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 299us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430831.116576:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:0.0:1787430831.122434:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836239872 00000100:00100000:0.0:1787430831.122451:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836239872 00000100:00100000:0.0:1787430831.122582:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:0.0:1787430831.122594:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12208:x1874256836239872:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430831.123261:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430831.123285:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94a74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a81 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.123464:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94a7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.123480:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94a7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.123493:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94a7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430831.123525:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787430831.124306:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94a74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a81 expref: 28 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.124682:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94a7b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a81 expref: 27 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.124694:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:0.0:1787430831.124697:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787430831.124701:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174c00, rc 0) 00000100:00100000:0.0:1787430831.124773:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12208:x1874256836239872:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2181us (8958us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1787430831.124782:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:1.0:1787430831.137517:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430831.137641:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836240128 00000100:00100000:3.0:1787430831.137653:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836240128 00000100:00100000:3.0:1787430831.137709:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:3.0:1787430831.137720:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836240128:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:3.0:1787430831.137785:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.137807:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 7 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.137816:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430831.137820:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430831.137824:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.138210:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 7 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.138228:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 7 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430831.138244:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847820800:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430831.138511:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787430831.144206:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430831.144708:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836240256 00000100:00100000:0.0:1787430831.144719:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836240256 00002000:00100000:0.0:1787430831.144772:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8e2c35d65c00 x1874256836240256/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:52/0 lens 504/0 e 0 to 0 dl 1787430842 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430831.144784:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2c35d65c00 with x1874256836240256 ext(0->12) 00010000:00010000:0.0:1787430831.144795:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 8 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.144813:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 8 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430831.144821:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2c35d65c00 00000100:00100000:0.0:1787430831.144854:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:0.0:1787430831.144893:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836240256:12345-192.168.202.25@tcp:4:lfs.0 00000100:00100000:3.0:1787430831.146325:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847820800:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430831.146371:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787430831.149778:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000001:00100000:1.0:1787430831.149790:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:1.0:1787430831.149794:0:9485:0:(genops.c:885:class_export_put()) final put ffff8e2c0782e000/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:2.0:1787430831.150791:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c0782e000/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-OST0001 00000020:00000080:2.0:1787430831.150836:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c0782d000 for lustre-OST0001 00000100:00100000:2.0:1787430831.151929:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2399:x1874256836240256:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 7030us (7733us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787430831.151942:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00002000:00100000:2.0:1787430831.151964:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8e2c35d65c00 x1874256836240256/t4294967306(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:52/0 lens 504/448 e 0 to 0 dl 1787430842 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430831.151975:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2c35d65c00 with x1874256836240256 ext(0->12) 00010000:00010000:2.0:1787430831.152001:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 9 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.152021:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 9 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430831.152031:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2c35d65c00 00000100:00100000:0.0:1787430831.166715:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430831.166875:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836240384 00000100:00100000:3.0:1787430831.166885:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836240384 00010000:00010000:3.0:1787430831.166927:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 9 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430831.166996:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:3.0:1787430831.167007:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2400:x1874256836240384:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430831.167023:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787430831.167042:0:6482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787430831.167045:0:6482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787430830 00002000:00010000:3.0:1787430831.167048:0:6482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787430831 00002000:00010000:3.0:1787430831.167050:0:6482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787430830 00002000:00010000:3.0:1787430831.167052:0:6482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787430831.167057:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 9 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.167071:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 9 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.167093:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94a3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a65 expref: 9 pid: 8830 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.167109:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430831.167114:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430831.167119:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.167129:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430831.167176:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430831.167267:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836240384:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 262us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430831.167275:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00010000:00010000:2.0:1787430831.167869:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167880:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167901:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167909:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167918:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167925:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430831.167929:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167937:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167972:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.167980:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004767eb6/0x4dbb683ba6a94a89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430831.168046:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836240128:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 30327us (30538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430831.168055:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1787430831.170704:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430831.170878:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836240640 00000100:00100000:2.0:1787430831.170889:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836240640 00000100:00100000:1.0:1787430831.171119:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:1.0:1787430831.171134:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12208:x1874256836240640:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:1.0:1787430831.171219:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94a7b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a81 expref: 27 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430831.171556:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787430831.171592:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787430831.172226:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787430831.172274:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.172291:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 31 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.172310:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430831.172484:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1787430831.172493:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00010000:1.0:1787430831.173443:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 31 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.173463:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 31 pid: 10098 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430831.173480:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0493aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1874256847820928:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430831.173595:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430831.186371:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430831.186549:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0493aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1874256847820928:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430831.186579:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430831.186704:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836240768 00000100:00100000:0.0:1787430831.186712:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836240768 00010000:00010000:0.0:1787430831.186752:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 32 pid: 10098 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430831.186794:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:0.0:1787430831.186806:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:2400:x1874256836240768:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430831.186822:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430831.186829:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 32 pid: 10098 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.186843:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 32 pid: 10098 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.186878:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94a20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a57 expref: 32 pid: 10098 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.186896:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:0.0:1787430831.186901:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.186910:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.186917:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.186968:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430831.187022:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+31:2400:x1874256836240768:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 218us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430831.187030:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 82 00010000:00010000:1.0:1787430831.187238:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.187247:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430831.187365:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1787430831.187475:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787430831.187560:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847821056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787430831.187648:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.187689:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430831.187815:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821056 00000100:00100000:2.0:1787430831.187821:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821056 00000100:00100000:2.0:1787430831.187873:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787430831.187882:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6500:x1874256847821056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787430831.187971:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6500:x1874256847821056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430831.187979:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1787430831.188173:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430831.188211:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847821056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787430831.188320:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1787430831.188445:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d63800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847821184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787430831.188487:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.188546:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430831.195478:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821184 00000100:00100000:0.0:1787430831.195498:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821184 00000100:00100000:0.0:1787430831.196153:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787430831.196170:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1874256847821184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787430831.196476:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6500:x1874256847821184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 311us (7987us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787430831.196484:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787430831.201343:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d63800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847821184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787430831.201475:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787430831.201557:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.201568:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.201576:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.201582:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430831.201587:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.201594:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.202198:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:2.0:1787430831.202202:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787430831.202207:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.202214:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94a90 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430831.202507:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787430831.202578:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787430831.202590:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 292674987717ns, next at 293674985527ns, rc = 0 00000001:00080000:2.0:1787430831.202820:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787430831.204852:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:3.0:1787430831.209203:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787430831.209221:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94a7b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a81 expref: 35 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430831.209418:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:12208:x1874256836240640:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 38286us (38722us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787430831.209428:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00000020:00080000:3.0:1787430831.209435:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787430831.214049:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430831.214214:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836240896 00000100:00100000:2.0:1787430831.214225:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836240896 00000100:00100000:2.0:1787430831.214308:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:2.0:1787430831.214321:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:12208:x1874256836240896:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430831.214470:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430831.214496:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94a97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a88 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.214564:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94a97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a88 expref: 35 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.214580:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94a97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a88 expref: 35 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430831.214631:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430831.214636:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430831.214640:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02e00, rc 0) 00000100:00100000:2.0:1787430831.214697:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:12208:x1874256836240896:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 380us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430831.214704:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:2.0:1787430831.220057:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430831.220239:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836241152 00000100:00100000:0.0:1787430831.220249:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836241152 00000100:00100000:0.0:1787430831.220313:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:0.0:1787430831.220324:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:12208:x1874256836241152:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430831.220582:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+36:12208:x1874256836241152:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 259us (537us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787430831.220591:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:3.0:1787430831.359816:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847821312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430831.359895:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430831.360014:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430831.360025:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847821440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430831.360058:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430831.360263:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430831.360271:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821312 00000100:00100000:3.0:1787430831.360274:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847821568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430831.360279:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821312 00000100:00100000:3.0:1787430831.360301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430831.360329:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821568 00000100:00100000:3.0:1787430831.360333:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821568 00000100:00100000:3.0:1787430831.360354:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787430831.360362:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847821312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430831.360383:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787430831.360392:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430831.360424:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847821312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430831.360488:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847822080:0@lo:400:kworker.0 00000100:00100000:2.0:1787430831.360519:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430831.360541:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430831.360556:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847821952:0@lo:400:kworker.0 00000100:00100000:2.0:1787430831.360581:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.360803:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847821696:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.360842:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.360867:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847822208:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.360890:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.360908:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847822720:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.360929:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.360960:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787430831.360967:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847821824:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.360992:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.361013:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847822336:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361034:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.361050:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847822848:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361073:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.361104:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821696 00000100:00100000:1.0:1787430831.361108:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821696 00000100:00100000:1.0:1787430831.361140:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787430831.361148:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847821696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361195:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3629:x1874256847821696:12345-0@lo:400:kworker.0 Request processed in 37us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.361202:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787430831.361239:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847822080 00000100:00100000:1.0:1787430831.361251:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847822080 00000100:00100000:1.0:1787430831.361271:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847822208 00000100:00100000:1.0:1787430831.361274:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847822208 00000100:00100000:1.0:1787430831.361294:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847822720 00000100:00100000:1.0:1787430831.361296:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847822720 00000100:00100000:1.0:1787430831.361309:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821824 00000100:00100000:1.0:1787430831.361312:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821824 00000100:00100000:1.0:1787430831.361322:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847822336 00000100:00100000:1.0:1787430831.361324:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847822336 00000100:00100000:1.0:1787430831.361360:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847822848 00000100:00100000:1.0:1787430831.361363:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847822848 00000100:00100000:1.0:1787430831.361376:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787430831.361381:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847822080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361416:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847822080:12345-0@lo:400:kworker.0 Request processed in 35us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.361422:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787430831.361433:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787430831.361438:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847822208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361466:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847822208:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.361473:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787430831.361486:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787430831.361492:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847822720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361517:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847822720:12345-0@lo:400:kworker.0 Request processed in 25us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.361522:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787430831.361534:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787430831.361539:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847821824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361577:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847821824:12345-0@lo:400:kworker.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.361584:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787430831.361596:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787430831.361627:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847822336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361657:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847822336:12345-0@lo:400:kworker.0 Request processed in 55us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.361662:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787430831.361674:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787430831.361680:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847822848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361708:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847822848:12345-0@lo:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.361713:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1787430831.361739:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787430831.361743:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430831.361760:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847822464:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361792:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.361819:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430831.361825:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847822592:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.361847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430831.361877:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821440 00000100:00100000:1.0:1787430831.361881:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821440 00000100:00100000:1.0:1787430831.361906:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847821952 00000100:00100000:1.0:1787430831.361909:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847821952 00000100:00100000:1.0:1787430831.361923:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787430831.361930:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847821440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787430831.361975:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787430831.362010:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847821440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.362016:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787430831.362029:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787430831.362035:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847821952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362063:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847821952:12345-0@lo:400:kworker.0 Request processed in 29us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.362069:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787430831.362104:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847821952:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362117:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847822080:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362132:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847821440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430831.362165:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847821824:0@lo:400:kworker.0 00010000:00080000:1.0:1787430831.362177:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e14000 x1874256847822336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430831.362199:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847822336:0@lo:400:kworker.0 00010000:00080000:1.0:1787430831.362210:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c3f900380 x1874256847822848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430831.362217:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847822848:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362225:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847821696:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362234:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847822208:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362255:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847822720:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362302:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847822464 00000100:00100000:1.0:1787430831.362305:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847822464 00000100:00100000:1.0:1787430831.362337:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847822592 00000100:00100000:1.0:1787430831.362340:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847822592 00000100:00100000:1.0:1787430831.362361:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787430831.362367:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1157ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847822464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362407:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1157ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847822464:12345-0@lo:400:kworker.0 Request processed in 40us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.362413:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787430831.362424:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787430831.362430:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847822592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362457:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847822592:12345-0@lo:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.362463:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787430831.362480:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430831.362498:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847822592:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362507:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847822464:0@lo:400:kworker.0 00000100:00100000:1.0:1787430831.362586:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847821312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430831.372225:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787430831.372260:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847821568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430831.372297:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430831.373073:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847821568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 824us (12762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430831.373105:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787430831.374089:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787430831.376093:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847821568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430831.380100:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.382326:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836241408 00000100:00100000:1.0:1787430831.382339:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836241408 00000100:00100000:1.0:1787430831.382403:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:1.0:1787430831.382411:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+36:12218:x1874256836241408:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430831.382455:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430831.382476:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a8f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430831.382570:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787430831.382709:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94a9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a8f expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.382725:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:1.0:1787430831.382728:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430831.382734:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a8f expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.382748:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031a00, rc 0) 00000100:00100000:1.0:1787430831.382809:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12218:x1874256836241408:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 399us (2719us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1787430831.382817:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:1.0:1787430831.396539:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430831.396642:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836241536 00000100:00100000:0.0:1787430831.396652:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836241536 00000100:00100000:0.0:1787430831.396720:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:0.0:1787430831.396731:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12218:x1874256836241536:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:0.0:1787430831.396812:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396830:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396841:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396864:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396871:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396877:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396973:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396982:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.396989:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430831.397055:0:13789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397068:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397074:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397080:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397086:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430831.397090:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397096:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397109:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430831.397112:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430831.397117:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397123:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94aac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397139:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397145:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397159:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397165:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430831.397168:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397175:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397194:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430831.397197:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430831.397201:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397207:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ab3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397218:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397225:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397231:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397235:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430831.397238:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397253:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397262:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430831.397264:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430831.397267:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.397272:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94aba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430831.397366:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12218:x1874256836241536:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 635us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430831.397373:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:3.0:1787430831.401903:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.401981:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836241792 00000100:00100000:1.0:1787430831.401993:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836241792 00000100:00100000:1.0:1787430831.402055:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:1.0:1787430831.402066:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12218:x1874256836241792:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1787430831.402315:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:12218:x1874256836241792:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 249us (422us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787430831.402323:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:3.0:1787430831.471383:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.471480:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836242048 00000100:00100000:1.0:1787430831.471506:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836242048 00000100:00100000:1.0:1787430831.471572:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:1.0:1787430831.471585:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:12221:x1874256836242048:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430831.471652:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430831.471677:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ac1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a96 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471754:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471769:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471782:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471792:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471799:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471805:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471936:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471945:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.471962:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430831.471980:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787430831.472073:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472081:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472088:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472095:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430831.472099:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472106:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472118:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430831.472122:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430831.472125:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472131:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94ac8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472145:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472152:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472168:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472173:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430831.472176:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472192:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472202:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:1.0:1787430831.472205:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430831.472208:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472214:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94acf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472251:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ac1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472263:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.472271:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430831.472274:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430831.472276:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030600, rc 0) 00000100:00100000:1.0:1787430831.472331:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:12221:x1874256836242048:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 748us (957us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787430831.472346:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:2.0:1787430831.486462:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.486891:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836242176 00000100:00100000:1.0:1787430831.486912:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836242176 00000100:00100000:1.0:1787430831.487144:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:1.0:1787430831.487155:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:12221:x1874256836242176:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:1.0:1787430831.487254:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487274:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487288:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487339:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487347:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487356:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487362:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430831.487368:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487377:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487392:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430831.487411:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430831.487417:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.487425:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ae4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430831.487509:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:12221:x1874256836242176:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 355us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.487517:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:0.0:1787430831.499803:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430831.499927:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836242432 00000100:00100000:2.0:1787430831.499938:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836242432 00000100:00100000:2.0:1787430831.500015:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:2.0:1787430831.500026:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:12221:x1874256836242432:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430831.500291:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+41:12221:x1874256836242432:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 266us (498us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787430831.500299:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000040:00080000:1.0:1787430831.552513:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787430831.802445:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430831.802699:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836242688 00000100:00100000:0.0:1787430831.802711:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836242688 00000100:00100000:0.0:1787430831.802778:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:0.0:1787430831.802791:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+41:12252:x1874256836242688:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:0.0:1787430831.802819:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430831.802841:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94aeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138a9d expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.802982:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94af2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.802998:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.803034:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430831.803047:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787430831.803159:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94aeb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a9d expref: 44 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.803190:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94af2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a9d expref: 43 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.803200:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430831.803203:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430831.803207:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175200, rc 0) 00000100:00100000:0.0:1787430831.803275:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:12252:x1874256836242688:12345-192.168.202.25@tcp:101:cat.0 Request processed in 487us (845us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787430831.803283:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:1.0:1787430831.807149:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.807208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430831.807292:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836243072 00000100:00100000:0.0:1787430831.807302:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836243072 00000100:00100000:0.0:1787430831.807372:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1787430831.807383:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:2399:x1874256836243072:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430831.807398:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430831.807425:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94af2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a9d expref: 43 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.807449:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430831.807454:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430831.807527:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:2399:x1874256836243072:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 145us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430831.807535:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:3.0:1787430831.807751:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836242944 00000100:00100000:3.0:1787430831.807757:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836242944 00000100:00100000:3.0:1787430831.807799:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:3.0:1787430831.807807:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:12252:x1874256836242944:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:3.0:1787430831.808057:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:12252:x1874256836242944:12345-192.168.202.25@tcp:35:cat.0 Request processed in 250us (916us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1787430831.808064:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:3.0:1787430831.892931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.893212:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836243328 00000100:00100000:1.0:1787430831.893223:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836243328 00000100:00100000:1.0:1787430831.893287:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:1.0:1787430831.893298:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:12258:x1874256836243328:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:1.0:1787430831.893322:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430831.893341:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787430831.893371:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94a58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a73 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.893393:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430831.893397:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430831.893410:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94b00 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138aa4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.893508:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.893540:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.893549:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.893584:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.893658:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 43 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430831.893684:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3a63b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847822976:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430831.893790:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03497900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430831.896644:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430831.897125:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836243456 00000100:00100000:0.0:1787430831.897136:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836243456 00010000:00010000:0.0:1787430831.897188:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 44 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430831.897238:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:0.0:1787430831.897249:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11441450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+44:2400:x1874256836243456:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430831.897263:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430831.897270:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 44 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.897283:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 44 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.897304:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430831.897309:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.897318:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.897336:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.897358:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430831.897418:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11441450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+44:2400:x1874256836243456:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 171us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430831.897444:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 83 00010000:00010000:1.0:1787430831.897716:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94ad6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a96 expref: 43 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430831.897733:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3a63b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847822976:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430831.897751:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.897760:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.897766:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430831.897783:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787430831.898135:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94b00 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.898153:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.898161:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430831.898164:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430831.898166:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030c00, rc 0) 00000100:00100000:1.0:1787430831.898206:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:12258:x1874256836243328:12345-192.168.202.25@tcp:101:dd.0 Request processed in 4909us (5284us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787430831.898212:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:0.0:1787430831.902142:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430831.902241:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836243584 00000100:00100000:1.0:1787430831.902253:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836243584 00000100:00100000:1.0:1787430831.902315:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:1.0:1787430831.902326:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:12258:x1874256836243584:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:1.0:1787430831.902351:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430831.902372:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94b15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138aab expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.902408:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.902422:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.902433:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.902566:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94b15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 45 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.902586:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430831.902595:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430831.902932:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787430831.902936:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031a00, rc 0) 00000100:00100000:1.0:1787430831.903119:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+44:12258:x1874256836243584:12345-192.168.202.25@tcp:101:dd.0 Request processed in 793us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430831.903126:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:3.0:1787430831.913459:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430831.913665:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836243840 00000100:00100000:0.0:1787430831.913686:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836243840 00000100:00100000:0.0:1787430831.913756:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 169 00000100:00100000:0.0:1787430831.913770:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+44:12258:x1874256836243840:12345-192.168.202.25@tcp:36:dd.0 00010000:00010000:0.0:1787430831.914531:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.914552:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.914565:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430831.914648:0:13789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1787430831.914675:0:13789:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f5fde66 reply state 000000000816d2f2 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.914824:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430831.914844:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430831.914847:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430831.915313:0:13789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430831.915518:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+47:12258:x1874256836243840:12345-192.168.202.25@tcp:36:dd.0 Request processed in 1748us (2066us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787430831.915528:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 169 00000020:00080000:0.0:1787430831.915533:0:13789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787430832.134783:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430832.301203:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430832.301308:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836243968 00000100:00100000:3.0:1787430832.301319:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836243968 00000100:00100000:3.0:1787430832.301423:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:3.0:1787430832.301436:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+47:12273:x1874256836243968:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:3.0:1787430832.301461:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430832.301484:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94b2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ab2 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.301571:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787430832.302023:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430832.302111:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302124:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302141:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302148:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302154:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302236:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302247:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302256:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302290:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.302305:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 48 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430832.302331:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847823104:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430832.302547:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787430832.316421:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430832.316895:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836244224 00000100:00100000:0.0:1787430832.316907:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836244224 00000100:00100000:0.0:1787430832.316989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1787430832.317001:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+49:6159:x1874256836244224:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787430832.317635:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847823104:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430832.317660:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430832.318326:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+50:6159:x1874256836244224:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 1324us (1924us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787430832.318337:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1787430832.326201:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430832.326650:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836244352 00000100:00100000:2.0:1787430832.326661:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836244352 00010000:00010000:2.0:1787430832.326704:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 50 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430832.326748:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:2.0:1787430832.326759:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+50:2399:x1874256836244352:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430832.326775:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430832.326782:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 50 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.326797:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 50 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.326821:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b07 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aa4 expref: 50 pid: 6496 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.326839:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430832.326845:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.326871:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.326879:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.326914:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430832.326981:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+49:2399:x1874256836244352:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 222us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430832.326989:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 84 00010000:00010000:3.0:1787430832.327308:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327317:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430832.327373:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787430832.327377:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430832.327418:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327432:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327440:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327447:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327453:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327459:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430832.327471:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327479:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327488:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:3.0:1787430832.327491:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430832.327494:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327500:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94b31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327512:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327518:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327523:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327528:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430832.327530:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327535:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327541:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:3.0:1787430832.327544:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430832.327553:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327559:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327595:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94b2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab2 expref: 49 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327670:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab2 expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.327677:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:3.0:1787430832.327680:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430832.327682:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8aa00, rc 0) 00000100:00100000:3.0:1787430832.327722:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+48:12273:x1874256836243968:12345-192.168.202.25@tcp:101:stat.0 Request processed in 26289us (26530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430832.327730:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:3.0:1787430832.414709:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430832.415192:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836244608 00000100:00100000:1.0:1787430832.415205:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836244608 00000100:00100000:1.0:1787430832.415289:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 171 00000100:00100000:1.0:1787430832.415303:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+48:12279:x1874256836244608:12345-192.168.202.25@tcp:36:truncate.0 00010000:00010000:1.0:1787430832.415370:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430832.415415:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94b3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab2 expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430832.415438:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430832.415444:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430832.415692:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430832.415725:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430832.415735:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430832.415792:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1787430832.415814:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091b5f630 reply state 000000003f85da20 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430832.415826:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430832.415833:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430832.415835:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787430832.415839:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430832.415961:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+50:12279:x1874256836244608:12345-192.168.202.25@tcp:36:truncate.0 Request processed in 660us (1374us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787430832.415969:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 171 00000020:00080000:1.0:1787430832.415975:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787430832.624716:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430832.624882:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836244736 00000100:00100000:0.0:1787430832.624892:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836244736 00000100:00100000:0.0:1787430832.624960:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00100000:0.0:1787430832.624972:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+50:12293:x1874256836244736:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:0.0:1787430832.625001:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430832.625038:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ab9 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625105:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625120:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625132:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625144:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625150:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625191:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625278:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625287:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625294:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430832.625344:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787430832.625350:0:8819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430832.625382:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625395:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625901:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625909:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625916:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625921:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.625925:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625942:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625956:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430832.625959:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.625963:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625969:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94b54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625985:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625992:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.625998:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.626003:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.626006:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.626011:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.626019:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430832.626021:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.626024:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.626040:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.626074:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 52 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.626087:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 51 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.626094:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430832.626096:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430832.626099:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174800, rc 0) 00000100:00100000:0.0:1787430832.626397:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+51:12293:x1874256836244736:12345-192.168.202.25@tcp:101:stat.0 Request processed in 1425us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430832.626479:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00100000:3.0:1787430832.798427:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430832.798583:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836244992 00000100:00100000:2.0:1787430832.798593:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836244992 00000100:00100000:2.0:1787430832.798693:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 173 00000100:00100000:2.0:1787430832.798705:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+51:12303:x1874256836244992:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430832.798729:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430832.798753:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ac0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430832.798852:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787430832.798956:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94b69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac0 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.798971:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:2.0:1787430832.798974:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430832.798980:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94b69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac0 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.798994:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02200, rc 0) 00000100:00100000:2.0:1787430832.799074:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+52:12303:x1874256836244992:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 370us (655us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1787430832.799082:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 173 00000100:00100000:3.0:1787430832.801873:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430832.801971:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836245248 00000100:00100000:0.0:1787430832.801982:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836245248 00000100:00100000:0.0:1787430832.802046:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:0.0:1787430832.802058:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e58450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+52:12303:x1874256836245248:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430832.802288:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e58450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+53:12303:x1874256836245248:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 233us (425us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1787430832.802296:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:1.0:1787430832.931221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430832.931350:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836245504 00000100:00100000:2.0:1787430832.931362:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836245504 00000100:00100000:2.0:1787430832.931429:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 174 00000100:00100000:2.0:1787430832.931441:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+53:12309:x1874256836245504:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430832.931466:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430832.931488:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94b77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ac7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.931655:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.931672:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 54 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.931682:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.931719:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 54 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.931731:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 54 pid: 8819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430832.931743:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1874256847823232:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430832.931862:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430832.934630:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1874256847823232:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430832.934664:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430832.937545:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430832.937681:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836245632 00000100:00100000:3.0:1787430832.937691:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836245632 00010000:00010000:3.0:1787430832.937821:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 55 pid: 8819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430832.937879:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:3.0:1787430832.937890:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+55:2399:x1874256836245632:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430832.937905:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430832.937926:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 55 pid: 8819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.937940:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 55 pid: 8819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.937968:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174800/0x4dbb683ba6a94b62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ab9 expref: 55 pid: 8819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.937989:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:3.0:1787430832.937995:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.938007:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.938014:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.938049:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430832.938125:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:2399:x1874256836245632:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 236us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430832.938132:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 85 00010000:00010000:2.0:1787430832.942276:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.942298:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430832.942328:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787430832.942499:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94b77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 55 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.942518:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.942526:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430832.942530:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787430832.942533:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03400, rc 0) 00000100:00100000:2.0:1787430832.942662:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a63b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:12309:x1874256836245504:12345-192.168.202.25@tcp:101:bash.0 Request processed in 11222us (11452us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787430832.942671:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 174 00000100:00100000:1.0:1787430832.946452:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430832.946554:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836245888 00000100:00100000:0.0:1787430832.946564:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836245888 00000100:00100000:0.0:1787430832.946673:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:0.0:1787430832.946685:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:12309:x1874256836245888:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:0.0:1787430832.946954:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.946973:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.946984:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430832.947029:0:8819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1787430832.947051:0:8819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077bcdb99 reply state 00000000e15e400f transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.947065:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.947073:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430832.947076:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430832.947079:0:8819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430832.947165:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+57:12309:x1874256836245888:12345-192.168.202.25@tcp:36:bash.0 Request processed in 482us (723us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1787430832.947180:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 175 00000020:00080000:0.0:1787430832.947185:0:8819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787430832.963440:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430832.963534:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836246016 00000100:00100000:2.0:1787430832.963545:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836246016 00000100:00100000:2.0:1787430832.963654:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 176 00000100:00100000:2.0:1787430832.963666:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+57:12309:x1874256836246016:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430832.963691:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430832.963729:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94b93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ace expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.963851:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.963866:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 58 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.963874:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.963906:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 58 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.963918:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 58 pid: 6499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430832.963932:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847823360:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430832.964034:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430832.972402:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430832.972506:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836246144 00000100:00100000:0.0:1787430832.972517:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836246144 00010000:00010000:0.0:1787430832.972565:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 59 pid: 6499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430832.972655:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:0.0:1787430832.972668:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:2399:x1874256836246144:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430832.972700:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430832.972708:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 59 pid: 6499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.972723:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 59 pid: 6499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.972747:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430832.972752:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.972764:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.972771:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.972789:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430832.972850:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:2399:x1874256836246144:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 185us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430832.972859:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 86 00010000:00010000:2.0:1787430832.973095:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94b7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ac7 expref: 58 pid: 6499 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430832.973112:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847823360:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430832.973131:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.973140:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.973157:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430832.973223:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787430832.973227:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430832.973250:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.973277:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94b93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ace expref: 58 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.973303:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ace expref: 57 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430832.973311:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430832.973313:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430832.973316:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03c00, rc 0) 00000100:00100000:2.0:1787430832.973344:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+57:12309:x1874256836246016:12345-192.168.202.25@tcp:101:bash.0 Request processed in 9681us (9917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430832.973351:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 176 00000100:00100000:1.0:1787430832.977118:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430832.977280:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836246400 00000100:00100000:3.0:1787430832.977290:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836246400 00000100:00100000:3.0:1787430832.977350:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:3.0:1787430832.977362:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+57:12309:x1874256836246400:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:3.0:1787430832.977665:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+58:12309:x1874256836246400:12345-192.168.202.25@tcp:35:bash.0 Request processed in 305us (557us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787430832.977683:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000001:00080000:2.0:1787430832.981446:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000004:00080000:2.0:1787430832.981488:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1787430832.981574:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981596:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981625:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981646:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.981651:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981658:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981682:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e2c132d1500) 00010000:00010000:0.0:1787430832.981685:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.981689:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981695:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a949d3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981714:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981719:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981724:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981729:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.981732:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981737:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981753:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430832.981755:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.981758:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981764:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a949da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981778:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981783:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981788:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981792:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.981795:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981800:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981806:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430832.981809:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.981811:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981816:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94a19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981852:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981858:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981864:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981869:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.981872:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981877:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981885:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430832.981888:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.981890:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981895:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94b23 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981907:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981913:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981919:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981930:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.981934:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981940:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981949:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430832.981952:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.981955:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981960:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94b46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981971:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981977:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981982:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981986:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430832.981988:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.981993:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.982011:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430832.982013:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430832.982015:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.982021:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94b8c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430832.994007:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430832.994033:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847823488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787430832.994111:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430832.995277:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847823488 00000100:00100000:3.0:1787430832.995289:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847823488 00000100:00100000:3.0:1787430832.995350:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787430832.995361:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847823488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787430832.995391:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1787430832.995436:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a07ae, atime: 0x6a8a07af, ctime: 0x6a8a07ae, blocks: 0x8 00010000:00010000:3.0:1787430832.995445:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.995462:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:3.0:1787430832.995466:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430832.995471:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.995487:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.995498:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.995506:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430832.995553:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787430832.995774:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3628:x1874256847823488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 414us (1662us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787430832.995782:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000004:00080000:3.0:1787430832.995827:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b04a12300/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787430832.995833:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847823488:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787430832.996190:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430832.996198:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.996207:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430832.996212:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.996222:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.996242:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.996249:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d60dff7/0x4dbb683ba6a94ba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430832.996284:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430832.996286:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430832.996288:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787430832.996469:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2b03497a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787430832.996475:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c10ffb100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b03497540 00000020:00080000:2.0:1787430832.996479:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c10ffb600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2c10b16000 00000020:00080000:1.0:1787430832.996565:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787430832.996648:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787430833.105766:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430833.105861:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836246656 00000100:00100000:1.0:1787430833.105873:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836246656 00000100:00100000:1.0:1787430833.105952:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 177 00000100:00100000:1.0:1787430833.105964:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+17:12319:x1874256836246656:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430833.105987:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430833.106007:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94ba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ad5 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430833.106122:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787430833.106262:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94ba8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ad5 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430833.106280:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:1.0:1787430833.106284:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430833.106289:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94ba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ad5 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430833.106304:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030800, rc 0) 00000100:00100000:1.0:1787430833.106380:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:12319:x1874256836246656:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 418us (623us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1787430833.106387:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 177 00000100:00100000:1.0:1787430833.111325:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430833.113703:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836246784 00000100:00100000:0.0:1787430833.113717:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836246784 00000100:00100000:0.0:1787430833.113789:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:0.0:1787430833.113800:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:12319:x1874256836246784:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:0.0:1787430833.113889:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.113906:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.113919:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.113945:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.113952:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.113959:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114234:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114244:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114274:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430833.114318:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114330:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114337:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114345:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114351:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430833.114354:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114360:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114372:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430833.114376:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430833.114380:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114461:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94bb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114477:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114488:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114494:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114499:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430833.114502:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114507:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114515:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430833.114518:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430833.114520:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114526:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94bbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114541:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114546:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114552:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114556:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430833.114566:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114573:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114581:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430833.114584:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430833.114586:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.114593:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94bc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430833.115279:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:12319:x1874256836246784:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 1474us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430833.115302:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:1.0:1787430833.122498:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430833.122684:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836247040 00000100:00100000:2.0:1787430833.122695:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836247040 00000100:00100000:2.0:1787430833.122758:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1787430833.122768:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:12319:x1874256836247040:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430833.123020:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:12319:x1874256836247040:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 252us (530us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787430833.123028:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00010000:00010000:2.0:1787430833.155879:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430833.193023:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430833.193120:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836247296 00000100:00100000:3.0:1787430833.193130:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836247296 00000100:00100000:3.0:1787430833.193209:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:3.0:1787430833.193219:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:12322:x1874256836247296:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430833.193242:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430833.193264:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94bcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138adc expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193336:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193351:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193363:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193380:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193422:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193429:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193546:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193556:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193564:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430833.193574:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787430833.193967:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193976:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193982:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.193988:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430833.193992:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194000:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194022:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:3.0:1787430833.194025:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430833.194029:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194035:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94bd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194046:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194052:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194058:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194064:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430833.194066:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194072:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194078:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c132d1300) 00010000:00010000:3.0:1787430833.194080:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430833.194083:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194089:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94bd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194136:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94bcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138adc expref: 22 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194218:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94be0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138adc expref: 21 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.194229:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:3.0:1787430833.194231:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430833.194234:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:3.0:1787430833.194350:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12322:x1874256836247296:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1130us (1334us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787430833.194358:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:1.0:1787430833.213255:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430833.213307:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430833.213452:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836247424 00000100:00100000:2.0:1787430833.213462:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836247424 00000100:00100000:2.0:1787430833.213519:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:2.0:1787430833.213536:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12322:x1874256836247424:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:2.0:1787430833.213630:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213647:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213658:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213694:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213701:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213708:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213721:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430833.213727:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213735:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213748:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430833.213755:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430833.213760:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.213766:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94bee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430833.213840:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12322:x1874256836247424:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 305us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430833.213849:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:3.0:1787430833.215331:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836247552 00000100:00100000:3.0:1787430833.215342:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836247552 00000100:00100000:3.0:1787430833.215407:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:3.0:1787430833.215416:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:2400:x1874256836247552:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430833.215428:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430833.215448:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94be0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138adc expref: 21 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430833.215464:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:3.0:1787430833.215468:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430833.215510:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:2400:x1874256836247552:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 95us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430833.215517:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:1.0:1787430833.227266:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430833.227370:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836247808 00000100:00100000:0.0:1787430833.227381:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836247808 00000100:00100000:0.0:1787430833.227442:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:0.0:1787430833.227455:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:12322:x1874256836247808:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430833.227718:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12322:x1874256836247808:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 264us (461us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787430833.227727:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:2.0:1787430833.373677:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430833.373877:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836248064 00000100:00100000:1.0:1787430833.373888:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836248064 00000100:00100000:1.0:1787430833.374003:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:1.0:1787430833.374030:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12340:x1874256836248064:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:1.0:1787430833.374056:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430833.374078:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94bf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ae3 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430833.374215:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94bfc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430833.374230:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94bfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430833.374242:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94bfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430833.374254:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787430833.374373:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94bf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ae3 expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430833.374391:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94bfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ae3 expref: 23 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430833.374399:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430833.374402:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787430833.374405:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030c00, rc 0) 00000100:00100000:1.0:1787430833.374469:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12340:x1874256836248064:12345-192.168.202.25@tcp:101:cat.0 Request processed in 441us (799us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787430833.374476:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:1.0:1787430833.416833:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430833.416971:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836248192 00000100:00100000:2.0:1787430833.416982:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836248192 00000100:00100000:2.0:1787430833.417046:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:2.0:1787430833.417057:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12341:x1874256836248192:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430833.417080:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430833.417101:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138aea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.417175:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.417208:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.417222:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430833.417271:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787430833.417275:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430833.417292:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.417317:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aea expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.417335:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aea expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.417344:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430833.417346:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430833.417350:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02a00, rc 0) 00000100:00100000:2.0:1787430833.417414:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12341:x1874256836248192:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 358us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430833.417421:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:1.0:1787430833.423855:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430833.423950:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836248576 00000100:00100000:3.0:1787430833.423960:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836248576 00000100:00100000:3.0:1787430833.424021:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:3.0:1787430833.424033:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12341:x1874256836248576:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1787430833.424338:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12341:x1874256836248576:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 306us (491us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787430833.424347:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:1.0:1787430833.431885:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430833.432003:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836248704 00000100:00100000:0.0:1787430833.432021:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836248704 00000100:00100000:0.0:1787430833.432131:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1787430833.432144:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12341:x1874256836248704:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:0.0:1787430833.432160:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787430833.432196:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94b9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ace expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.432244:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94bfc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ae3 expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.432259:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94a97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a88 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.432271:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430833.432277:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430833.432340:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12341:x1874256836248704:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 199us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430833.432349:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1787430833.440034:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430833.440135:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836248832 00000100:00100000:2.0:1787430833.440146:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836248832 00000100:00100000:2.0:1787430833.440233:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:2.0:1787430833.440245:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12341:x1874256836248832:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:2.0:1787430833.440366:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.440400:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430833.440414:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430833.440513:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787430833.440642:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12341:x1874256836248832:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 360us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430833.440649:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:1.0:1787430833.469014:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430833.469119:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836248960 00000100:00100000:0.0:1787430833.469130:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836248960 00000100:00100000:0.0:1787430833.469216:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:0.0:1787430833.469230:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12343:x1874256836248960:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430833.469252:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430833.469274:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94c1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138af1 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469341:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469356:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469368:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469415:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469424:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469431:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469502:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469512:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469519:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430833.469572:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787430833.469576:0:13789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430833.469633:0:13789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469646:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469653:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469660:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469676:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469683:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430833.469687:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469694:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469707:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430833.469710:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430833.469715:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469721:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94c26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469737:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469743:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469750:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469755:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430833.469758:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469773:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469781:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430833.469783:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430833.469786:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469792:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94c2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469821:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94c1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469834:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 23 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430833.469842:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430833.469844:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430833.469846:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175800, rc 0) 00000100:00100000:0.0:1787430833.469910:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12343:x1874256836248960:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 683us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430833.469917:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:1.0:1787430833.930812:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430833.930836:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847823616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430833.930904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430833.930967:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847823616 00000100:00100000:1.0:1787430833.930975:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847823616 00000100:00100000:1.0:1787430833.931027:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787430833.931036:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847823616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430833.931062:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787430833.931095:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847823616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430833.931100:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787430833.931116:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430833.931141:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847823616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430833.932745:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847823744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430833.932798:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430833.932877:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430833.932884:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847823872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430833.932915:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430833.933249:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847823872 00000100:00100000:3.0:1787430833.933257:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847823872 00000100:00100000:3.0:1787430833.933304:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787430833.933314:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847823872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430833.933333:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787430833.933379:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847823872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430833.933386:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787430833.935248:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430833.935313:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847823872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430833.940749:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847823744 00000100:00100000:0.0:1787430833.940763:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847823744 00000100:00100000:0.0:1787430833.940818:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787430833.941469:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847823744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787430833.941507:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787430833.941693:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847823744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 865us (8892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430833.941701:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787430833.942044:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847823744:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787430834.176835:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430834.176846:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430834.176872:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787430834.176883:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430834.177179:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0493a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847824000:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430834.177304:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c540 going to sleep for 11 seconds 00010000:00010000:2.0:1787430834.188237:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430834.193851:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0493a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847824000:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430834.199076:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.199296:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836249088 00000100:00100000:3.0:1787430834.199306:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836249088 00000100:00100000:3.0:1787430834.199396:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:3.0:1787430834.199407:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12354:x1874256836249088:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430834.199439:0:6496:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787430834.199553:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12354:x1874256836249088:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 147us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.199561:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00080000:0.0:1787430834.200079:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430834.202020:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.202092:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836249216 00000100:00100000:3.0:1787430834.202102:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836249216 00000100:00100000:3.0:1787430834.202190:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00100000:3.0:1787430834.202202:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12354:x1874256836249216:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787430834.202279:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202297:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202309:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202362:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202371:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202378:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202414:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202423:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202429:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430834.202471:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787430834.202475:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430834.202488:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202499:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202512:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202518:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202525:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430834.202529:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202537:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202550:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:3.0:1787430834.202554:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430834.202558:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202564:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94c3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202577:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.202595:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206414:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206425:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430834.206446:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206456:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206473:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8e2c132d1c00) 00010000:00010000:3.0:1787430834.206477:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430834.206481:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206488:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94c42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206513:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206520:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206526:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206531:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430834.206534:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206540:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206548:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:3.0:1787430834.206551:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430834.206559:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.206565:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94c49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430834.206673:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12354:x1874256836249216:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 4469us (4656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.206682:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00100000:3.0:1787430834.214918:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430834.215049:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836249472 00000100:00100000:1.0:1787430834.215059:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836249472 00000100:00100000:1.0:1787430834.215136:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:1.0:1787430834.215146:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12354:x1874256836249472:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430834.215176:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430834.215199:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94c50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138af8 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215313:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215329:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215342:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430834.215354:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787430834.215445:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215453:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215459:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215464:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430834.215468:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215475:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215498:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:1.0:1787430834.215501:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430834.215506:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215513:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94c57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215560:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94c50 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af8 expref: 25 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215570:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:1.0:1787430834.215573:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430834.215589:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031600/0x4dbb683ba6a94c50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af8 expref: 25 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.215627:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031600, rc 0) 00000100:00100000:1.0:1787430834.215686:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12354:x1874256836249472:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 541us (778us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1787430834.215693:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:3.0:1787430834.220317:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.220810:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836249600 00000100:00100000:0.0:1787430834.220820:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836249600 00000100:00100000:0.0:1787430834.220896:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:0.0:1787430834.220908:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12354:x1874256836249600:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787430834.220945:0:10098:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787430834.221064:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12354:x1874256836249600:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 159us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430834.221071:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:3.0:1787430834.231192:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430834.231268:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836249856 00000100:00100000:1.0:1787430834.231279:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836249856 00000100:00100000:1.0:1787430834.231336:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:1.0:1787430834.231347:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12354:x1874256836249856:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430834.231369:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430834.231372:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787430834.231407:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aea expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.231438:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430834.231442:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430834.231455:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c65 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138aff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430834.231866:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787430834.231993:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94c6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.232006:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.232016:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.232068:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aff expref: 26 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.232084:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aff expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.232091:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2b0353f900) 00010000:00010000:1.0:1787430834.232093:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430834.232096:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030600, rc 0) 00000100:00100000:1.0:1787430834.232173:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12354:x1874256836249856:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 825us (987us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787430834.232181:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:3.0:1787430834.261754:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430834.261970:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836250112 00000100:00100000:2.0:1787430834.261983:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836250112 00000100:00100000:2.0:1787430834.262048:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:2.0:1787430834.262058:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12354:x1874256836250112:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787430834.262115:0:13789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430834.262165:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94c6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aff expref: 25 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262199:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2b0353f900) 00010000:00010000:2.0:1787430834.262210:0:13789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430834.262234:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262248:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262258:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262312:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262320:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262328:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262377:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262738:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262749:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262754:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430834.262759:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262774:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262784:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430834.262787:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430834.262791:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262797:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94c7a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262809:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262816:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262822:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262827:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430834.262830:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262836:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262843:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x34a4fe40 (ffff8e2c11493900) 00010000:00010000:2.0:1787430834.262846:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430834.262849:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.262865:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94c81 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x34a4fe40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430834.263007:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12354:x1874256836250112:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 947us (1259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430834.263016:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:3.0:1787430834.265951:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430834.266052:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836250240 00000100:00100000:2.0:1787430834.266063:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836250240 00000100:00100000:2.0:1787430834.266113:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:2.0:1787430834.266124:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12354:x1874256836250240:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430834.266165:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430834.266192:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94c88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b06 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.266231:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.266245:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.266257:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.266376:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94c88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 26 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.266405:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 25 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.266414:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:2.0:1787430834.266417:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430834.266428:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02a00, rc 0) 00000100:00100000:2.0:1787430834.266489:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12354:x1874256836250240:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 366us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.266496:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:2.0:1787430834.268814:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430834.269025:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836250496 00000100:00100000:1.0:1787430834.269035:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836250496 00000100:00100000:1.0:1787430834.269089:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:1.0:1787430834.269100:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12354:x1874256836250496:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430834.269187:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.269204:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.269214:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430834.269372:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787430834.269382:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295741779429ns, next at 296741777264ns, rc = 0 00000004:00010000:1.0:1787430834.269511:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac8e6028 reply state 00000000c3731680 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.269525:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.269532:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:1.0:1787430834.269535:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787430834.269538:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430834.269649:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12354:x1874256836250496:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 550us (843us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787430834.269656:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:3.0:1787430834.282942:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.290621:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836250624 00000100:00100000:0.0:1787430834.290636:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836250624 00000100:00100000:0.0:1787430834.290700:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:0.0:1787430834.290712:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12354:x1874256836250624:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430834.290736:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430834.290755:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b0d expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.290809:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 28 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.290823:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 28 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.290841:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:0.0:1787430834.290854:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430834.290859:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174c00, rc 0) 00000100:00100000:0.0:1787430834.290928:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:12354:x1874256836250624:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 218us (7993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430834.290936:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:1.0:1787430834.303757:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.303916:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836250752 00000100:00100000:0.0:1787430834.303926:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836250752 00000100:00100000:0.0:1787430834.303997:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:0.0:1787430834.304010:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836250752:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787430834.304250:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836250752:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 242us (503us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787430834.304258:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00080000:1.0:1787430834.304393:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430834.318938:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.321711:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836251008 00000100:00100000:3.0:1787430834.321728:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836251008 00000100:00100000:3.0:1787430834.321806:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:3.0:1787430834.321817:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:12354:x1874256836251008:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787430834.322031:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:12354:x1874256836251008:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 216us (3103us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787430834.322040:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:3.0:1787430834.324618:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.324652:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836251264 00000100:00100000:3.0:1787430834.324660:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836251264 00000100:00100000:3.0:1787430834.324720:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:3.0:1787430834.324729:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:12354:x1874256836251264:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787430834.324824:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:12354:x1874256836251264:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.324831:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:3.0:1787430834.328274:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.328555:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836251392 00000100:00100000:0.0:1787430834.328566:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836251392 00000100:00100000:0.0:1787430834.328646:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 195 00000100:00100000:0.0:1787430834.328657:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:12354:x1874256836251392:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430834.328678:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430834.328699:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ca4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b14 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.328768:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.328783:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.328796:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430834.328858:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430834.328876:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.328902:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ca4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b14 expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.328922:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b14 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.328932:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:0.0:1787430834.328935:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787430834.328938:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175a00, rc 0) 00000100:00100000:0.0:1787430834.329000:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:12354:x1874256836251392:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 345us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430834.329007:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 195 00000100:00100000:3.0:1787430834.336250:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430834.336437:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836251520 00000100:00100000:1.0:1787430834.336460:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836251520 00000100:00100000:1.0:1787430834.336525:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:1.0:1787430834.336539:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836251520:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430834.336560:0:8830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430834.336594:0:8830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b1b expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430834.336650:0:8830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a07b2, blocks: 0x0 00010000:00010000:1.0:1787430834.336673:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=295s v=(0 0) 00010000:00010000:1.0:1787430834.336678:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430834.336688:0:8830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 8 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.336709:0:8830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 8 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.336724:0:8830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030c00, rc 0) 00000100:00100000:1.0:1787430834.336790:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2401:x1874256836251520:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 254us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430834.336797:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:0.0:1787430834.343996:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.344072:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836251776 00000100:00100000:3.0:1787430834.344083:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836251776 00000100:00100000:3.0:1787430834.344169:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 196 00000100:00100000:3.0:1787430834.344180:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:12354:x1874256836251776:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787430834.344302:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:12354:x1874256836251776:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.344311:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 196 00000100:00100000:3.0:1787430834.347334:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.347420:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836251904 00000100:00100000:0.0:1787430834.347429:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836251904 00000100:00100000:0.0:1787430834.347492:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:0.0:1787430834.347503:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:12354:x1874256836251904:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430834.347520:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430834.347541:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b22 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.347584:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 9 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.347639:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430834.347643:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430834.347650:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.347686:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 9 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.347700:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 9 pid: 8830 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430834.347715:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847824128:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430834.347801:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430834.358326:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.358361:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836252032 00000100:00100000:0.0:1787430834.358389:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836252032 00010000:00010000:0.0:1787430834.358433:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 10 pid: 8830 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430834.358470:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:0.0:1787430834.358480:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:2399:x1874256836252032:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430834.358496:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430834.358519:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 10 pid: 8830 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.358558:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 10 pid: 8830 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.358588:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430834.358593:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430834.358621:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.358631:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.358672:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430834.358686:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1874256847824256:192.168.202.25@tcp:105: 00000100:00100000:0.0:1787430834.358771:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed300 going to sleep for 11 seconds 00010000:00010000:3.0:1787430834.360644:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052662ee/0x4dbb683ba6a94cb2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b1b expref: 10 pid: 8830 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430834.360668:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847824128:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430834.360695:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.360709:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174600, rc 0) 00000100:00100000:3.0:1787430834.360770:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:12354:x1874256836251904:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 13268us (13446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.360789:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:1.0:1787430834.367757:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03cf2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1874256847824256:192.168.202.25@tcp:105: 00010000:00010000:1.0:1787430834.367788:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430834.367844:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836252032:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 9363us (9526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430834.367855:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:3.0:1787430834.377055:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430834.377154:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836252160 00000100:00100000:2.0:1787430834.377173:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836252160 00002000:00100000:2.0:1787430834.377225:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8e2b03490000 x1874256836252160/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:55/0 lens 504/0 e 0 to 0 dl 1787430845 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430834.377237:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b03490000 with x1874256836252160 ext(0->8) 00002000:00010000:2.0:1787430834.377243:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b03490000 00000100:00100000:2.0:1787430834.377278:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:2.0:1787430834.377287:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836252160:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787430834.381146:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:2399:x1874256836252160:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 3848us (4090us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787430834.381193:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00002000:00100000:2.0:1787430834.381210:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8e2b03490000 x1874256836252160/t4294967315(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:55/0 lens 504/448 e 0 to 0 dl 1787430845 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430834.381221:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b03490000 with x1874256836252160 ext(0->8) 00002000:00010000:2.0:1787430834.381229:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b03490000 00000100:00100000:1.0:1787430834.398544:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.398760:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836252288 00000100:00100000:3.0:1787430834.398770:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836252288 00000100:00100000:3.0:1787430834.398824:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 197 00000100:00100000:2.0:1787430834.411877:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:12354:x1874256836252288:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787430834.420379:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787430834.420396:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787430834.420435:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1787430834.420703:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:12354:x1874256836252288:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 21751us (22163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.420714:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 197 00000100:00100000:2.0:1787430834.420756:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847824384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787430834.420813:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430834.420980:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847824384 00000100:00100000:2.0:1787430834.420988:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847824384 00000100:00100000:2.0:1787430834.421027:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787430834.421035:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847824384:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1787430834.421251:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787430834.421262:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00002000:00010000:2.0:1787430834.421512:0:11754:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787430834.421516:0:11754:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787430834 00002000:00010000:2.0:1787430834.421518:0:11754:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787430834.421520:0:11754:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787430834 -> 1787430834 00002000:00010000:2.0:1787430834.421523:0:11754:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787430834.421636:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847824384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 600us (820us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787430834.421643:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:3.0:1787430834.422030:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.422040:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.422048:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.422054:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430834.422059:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.422066:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.422083:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:3.0:1787430834.422086:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787430834.422091:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.422096:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94c96 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.424745:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.424825:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836252416 00000100:00100000:3.0:1787430834.424838:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836252416 00000100:00100000:3.0:1787430834.424922:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1787430834.424932:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:2400:x1874256836252416:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787430834.427555:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b03de4700/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787430834.427582:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847824384:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1787430834.441404:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1787430834.441421:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1787430834.441645:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3a4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836252416:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 16707us (16901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.441657:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:2.0:1787430834.445445:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.445532:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836252672 00000100:00100000:0.0:1787430834.445543:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836252672 00000100:00100000:0.0:1787430834.445637:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:0.0:1787430834.445649:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:12354:x1874256836252672:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430834.445705:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430834.445733:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b14 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.445763:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:0.0:1787430834.445768:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430834.445799:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.445813:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.445823:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430834.445946:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3850c46 reply state 000000007ae92ca3 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.445960:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.445966:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:0.0:1787430834.445969:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430834.445971:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430834.446063:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:12354:x1874256836252672:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 416us (631us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1787430834.446071:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:0.0:1787430834.455958:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.456032:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836252800 00000100:00100000:3.0:1787430834.456043:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836252800 00000100:00100000:3.0:1787430834.456095:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1787430834.456106:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836252800:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787430834.456305:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787430834.456309:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787430834 -> 1787430833 00002000:00010000:3.0:1787430834.456312:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787430831 00002000:00010000:3.0:1787430834.456314:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787430834 -> 1787430833 00002000:00010000:3.0:1787430834.456316:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787430834.456395:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2402:x1874256836252800:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 282us (439us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787430834.456403:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:0.0:1787430834.469856:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.469904:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836253056 00000100:00100000:0.0:1787430834.469915:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836253056 00000100:00100000:0.0:1787430834.469975:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 199 00000100:00100000:0.0:1787430834.469988:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:12354:x1874256836253056:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787430834.470070:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.470087:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 20 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.470096:0:8819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.470128:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 20 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.470163:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 20 pid: 10098 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430834.470179:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847824512:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430834.470264:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430834.474892:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847824512:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430834.474928:0:8819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430834.479211:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430834.480134:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836253184 00000100:00100000:1.0:1787430834.480164:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836253184 00010000:00010000:1.0:1787430834.480208:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 21 pid: 10098 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430834.480257:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:1.0:1787430834.480267:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11442050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:2399:x1874256836253184:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430834.480282:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430834.480288:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 21 pid: 10098 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480301:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 21 pid: 10098 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480322:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94c8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b06 expref: 21 pid: 10098 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480336:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:1.0:1787430834.480341:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480352:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480373:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480400:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430834.480459:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11442050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:2399:x1874256836253184:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 192us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430834.480466:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 88 00010000:00010000:1.0:1787430834.480640:0:8819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480649:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480685:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480692:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480698:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480704:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430834.480708:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480715:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480724:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:1.0:1787430834.480733:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787430834.480737:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.480743:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94cc7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430834.480789:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:12354:x1874256836253056:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 10804us (10944us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787430834.480797:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 199 00000040:00080000:1.0:1787430834.484461:0:14630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430834.484472:0:14630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430834.484510:0:14630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787430834.484519:0:14630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430834.489678:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430834.494328:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836253312 00000100:00100000:2.0:1787430834.494346:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836253312 00000100:00100000:2.0:1787430834.494551:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:2.0:1787430834.494565:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2402:x1874256836253312:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787430834.494644:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.494681:0:8830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.494690:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430834.494694:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430834.494698:0:8830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.494735:0:8830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.494750:0:8830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 8 pid: 8411 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.494765:0:8830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8830:1874256847824640:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430834.494852:0:8830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430834.509428:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430834.510101:0:8830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8830:1874256847824640:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430834.510130:0:8830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430834.510377:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836253440 00000100:00100000:3.0:1787430834.510395:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836253440 00010000:00010000:3.0:1787430834.510434:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 9 pid: 8411 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430834.510484:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:3.0:1787430834.510494:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2399:x1874256836253440:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430834.510509:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430834.510543:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 9 pid: 8411 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.510557:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 9 pid: 8411 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.510588:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000984f68d7/0x4dbb683ba6a94cb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b22 expref: 9 pid: 8411 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.510643:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430834.510648:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430834.510653:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.510662:0:9495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.510684:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430834.510737:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836253440:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 244us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.510744:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 89 00010000:00010000:2.0:1787430834.511511:0:8830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511534:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511564:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511581:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511589:0:8830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511597:0:8830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430834.511622:0:8830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511631:0:8830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511645:0:8830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.511652:0:8830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94cce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.511721:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836253312:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 17158us (22052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.511729:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:0.0:1787430834.514762:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430834.514832:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836253696 00000100:00100000:3.0:1787430834.514843:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836253696 00000100:00100000:3.0:1787430834.514904:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 200 00000100:00100000:3.0:1787430834.514915:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:12354:x1874256836253696:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787430834.514998:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.515015:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.515024:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.515354:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430834.515369:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 19 pid: 6498 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430834.515462:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847824768:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430834.515550:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430834.524043:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430834.524294:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836253824 00000100:00100000:2.0:1787430834.524304:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836253824 00010000:00010000:2.0:1787430834.524343:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 20 pid: 6498 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.524388:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:2.0:1787430834.524399:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:2400:x1874256836253824:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430834.524411:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430834.524418:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 20 pid: 6498 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.524433:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 20 pid: 6498 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.524454:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430834.524459:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.524469:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.524476:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.524492:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430834.524544:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:2400:x1874256836253824:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 147us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.524551:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 90 00010000:00010000:0.0:1787430834.535967:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138aab expref: 19 pid: 6498 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430834.536035:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847824768:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430834.536064:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.536120:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.536148:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.536413:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.536428:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 19 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.536438:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.536508:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 19 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.536523:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 19 pid: 8819 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430834.536547:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847824896:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430834.551566:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430834.558507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.559993:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847824896:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430834.560028:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.560128:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836253952 00000100:00100000:2.0:1787430834.560170:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836253952 00010000:00010000:2.0:1787430834.560210:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 20 pid: 8819 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.560260:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:2.0:1787430834.560271:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b049a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:2400:x1874256836253952:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430834.560286:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430834.560293:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 20 pid: 8819 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.560306:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 20 pid: 8819 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.560328:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94c9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b0d expref: 20 pid: 8819 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.560343:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:2.0:1787430834.560348:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.560356:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.560363:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.560387:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430834.560440:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b049a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:2400:x1874256836253952:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 171us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.560456:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 91 00010000:00010000:1.0:1787430834.560971:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.560980:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430834.561104:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1787430834.561241:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1787430834.561278:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1787430834.561354:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874256847825024:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787430834.561417:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430834.561452:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c35000 going to sleep for 11 seconds 00000100:00100000:0.0:1787430834.561504:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847825024 00000100:00100000:0.0:1787430834.561511:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847825024 00000100:00100000:0.0:1787430834.561552:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787430834.561560:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6496:x1874256847825024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787430834.561670:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6496:x1874256847825024:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430834.561677:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787430834.565936:0:6496:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1787430834.565948:0:6496:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b03de4700, transno 4294967316 00000100:00100000:2.0:1787430834.565975:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f900380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874256847825024:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787430834.566160:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1787430834.566251:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874256847825152:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787430834.566315:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430834.566355:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430834.567190:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847825152 00000100:00100000:0.0:1787430834.567200:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847825152 00000100:00100000:0.0:1787430834.567255:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787430834.567266:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1874256847825152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787430834.567418:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6496:x1874256847825152:12345-0@lo:1000:mdt00_000.0 Request processed in 154us (1102us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787430834.567426:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787430834.567854:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1874256847825152:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787430834.567896:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.567907:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.567914:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.567920:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430834.567924:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.567932:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.567947:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:2.0:1787430834.567950:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430834.567954:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.567973:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94cdc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568000:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568006:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568012:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568017:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430834.568020:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568025:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568034:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430834.568037:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430834.568040:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568045:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94c18 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568067:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568081:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 22 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568097:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568126:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 22 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.568161:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 22 pid: 13789 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.568177:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847825280:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430834.568251:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430834.574866:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430834.574924:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836254080 00000100:00100000:0.0:1787430834.574932:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836254080 00010000:00010000:0.0:1787430834.574968:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 23 pid: 13789 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430834.575009:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 92 00000100:00100000:0.0:1787430834.575019:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2399:x1874256836254080:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430834.575033:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430834.575039:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 23 pid: 13789 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.575053:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 23 pid: 13789 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.575074:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:0.0:1787430834.575079:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.575100:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.575107:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430834.575125:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430834.575182:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2399:x1874256836254080:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 164us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430834.575189:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 92 00010000:00010000:2.0:1787430834.575426:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138af1 expref: 22 pid: 13789 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.575443:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1874256847825280:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430834.575463:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575471:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575477:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575489:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575495:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575508:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575514:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430834.575517:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575525:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575533:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430834.575536:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430834.575540:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575546:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94ce3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575555:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575560:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575566:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575578:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430834.575581:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575596:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575630:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b29900) 00010000:00010000:2.0:1787430834.575633:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430834.575636:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.575642:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94cd5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430834.575768:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12354:x1874256836253696:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 60854us (61015us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787430834.575776:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 200 00000020:00080000:2.0:1787430834.575779:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787430834.576591:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430834.576598:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430834.577112:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787430834.577122:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787430834.602434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430834.602542:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836254336 00000100:00100000:2.0:1787430834.602553:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836254336 00000100:00100000:2.0:1787430834.602639:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:2.0:1787430834.602652:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c10e5b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12354:x1874256836254336:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787430834.602916:0:14591:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787430834.602954:0:14591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1787430834.602989:0:14591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.603007:0:14591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.603018:0:14591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.603056:0:14591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.603063:0:14591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.603070:0:14591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430834.603090:0:14591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787430834.603206:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c10e5b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12354:x1874256836254336:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 555us (782us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787430834.603213:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000020:00080000:2.0:1787430834.603218:0:14591:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787430834.603377:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430834.603384:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.603391:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430834.603395:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.603402:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.603415:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:1.0:1787430834.603417:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787430834.603421:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.603427:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94cea lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430834.603437:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430834.603439:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430834.603440:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430835.200868:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430835.202313:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430835.202402:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430835.202432:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430835.202482:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836254848 00000100:00100000:3.0:1787430835.202492:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836254848 00000100:00100000:3.0:1787430835.202558:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 109 00000100:00100000:3.0:1787430835.202569:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836254848:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430835.202667:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836254848:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430835.202675:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 109 00000100:00100000:2.0:1787430835.209674:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430835.209713:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430835.209761:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836254464 00000100:00100000:1.0:1787430835.209772:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836254464 00000100:00100000:1.0:1787430835.209843:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 372 00000100:00100000:1.0:1787430835.209854:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836254464:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430835.209931:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2400:x1874256836254464:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430835.209939:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 372 00000100:00100000:0.0:1787430835.217501:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836254592 00000100:00100000:0.0:1787430835.217517:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836254592 00000100:00100000:0.0:1787430835.217744:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836255104 00000100:00100000:0.0:1787430835.217749:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836255104 00000100:00100000:1.0:1787430835.217768:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:1.0:1787430835.217794:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2400:x1874256836254592:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430835.217798:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 252 00000100:00100000:0.0:1787430835.217804:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836255104:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430835.217890:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2400:x1874256836254592:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 98us (15586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430835.217899:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:0.0:1787430835.217906:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836255104:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 103us (15474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430835.217985:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 252 00000100:00080000:0.0:1787430835.218004:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430835.219811:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430835.220007:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836254720 00000100:00100000:0.0:1787430835.220017:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836254720 00000100:00100000:0.0:1787430835.220078:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00100000:0.0:1787430835.220103:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836254720:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430835.220498:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836254720:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 397us (10782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430835.220506:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00080000:0.0:1787430835.220530:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430835.220706:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430835.228591:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836254976 00000100:00100000:1.0:1787430835.228622:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836254976 00000100:00100000:1.0:1787430835.228730:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00080000:0.0:1787430835.228739:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430835.228742:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836254976:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430835.228840:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836254976:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 100us (9036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430835.228847:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00100000:3.0:1787430835.229209:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836255232 00000100:00100000:3.0:1787430835.229215:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836255232 00000100:00100000:3.0:1787430835.229273:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 254 00000100:00100000:3.0:1787430835.229281:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836255232:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430835.229341:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2400:x1874256836255232:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 60us (8635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430835.229348:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 254 00000100:00080000:1.0:1787430835.230953:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787430836.224074:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430836.480133:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847825792:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480214:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480263:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847826304:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480290:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480306:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847826816:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480328:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480359:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787430836.480365:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847825408:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480392:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480410:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847825920:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480429:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480442:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847826432:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480470:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480485:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847826944:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480500:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480521:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847825536:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480542:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480567:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b02b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847826048:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480585:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480623:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847826560:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480641:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480657:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787430836.480662:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847825664:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480679:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480690:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847826176:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480707:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480719:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847826688:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480735:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430836.480761:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847825408 00000100:00100000:1.0:1787430836.480767:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847825408 00000100:00100000:1.0:1787430836.480805:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787430836.480814:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847825408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480859:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847825408:12345-0@lo:400:kworker.0 Request processed in 45us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430836.480866:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787430836.480894:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847825920 00000100:00100000:1.0:1787430836.480898:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847825920 00000100:00100000:1.0:1787430836.480923:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847825664 00000100:00100000:1.0:1787430836.480926:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847825664 00000100:00100000:1.0:1787430836.480938:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787430836.480943:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847825920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.480976:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847825920:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430836.480983:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787430836.480995:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787430836.481001:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847825664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481031:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847825664:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430836.481037:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787430836.481053:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826304 00000100:00100000:1.0:1787430836.481056:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826304 00000100:00100000:1.0:1787430836.481080:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826816 00000100:00100000:1.0:1787430836.481082:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826816 00000100:00100000:1.0:1787430836.481091:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826432 00000100:00100000:1.0:1787430836.481093:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826432 00000100:00100000:1.0:1787430836.481102:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826944 00000100:00100000:1.0:1787430836.481103:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826944 00000100:00100000:1.0:1787430836.481115:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787430836.481120:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847826304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481166:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847826304:12345-0@lo:400:kworker.0 Request processed in 44us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430836.481172:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787430836.481184:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787430836.481190:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847826816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481225:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847826816:12345-0@lo:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430836.481235:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787430836.481246:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787430836.481251:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847826432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481273:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847826432:12345-0@lo:400:kworker.0 Request processed in 22us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430836.481278:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787430836.481287:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787430836.481291:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481309:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847826944:12345-0@lo:400:kworker.0 Request processed in 18us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430836.481314:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787430836.481345:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847825408:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481356:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847825920:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481365:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847826432:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481373:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847826944:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481382:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847826304:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481389:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847826816:0@lo:400:kworker.0 00000100:00100000:1.0:1787430836.481424:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847825664:0@lo:400:kworker.0 00000100:00080000:1.0:1787430836.481436:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430836.481440:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430836.482152:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847825792 00000100:00100000:0.0:1787430836.482157:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847825792 00000100:00100000:0.0:1787430836.482185:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847825536 00000100:00100000:0.0:1787430836.482188:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847825536 00000100:00100000:0.0:1787430836.482200:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826048 00000100:00100000:0.0:1787430836.482203:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826048 00000100:00100000:0.0:1787430836.482223:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826560 00000100:00100000:0.0:1787430836.482226:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826560 00000100:00100000:0.0:1787430836.482236:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826176 00000100:00100000:0.0:1787430836.482238:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826176 00000100:00100000:0.0:1787430836.482248:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847826688 00000100:00100000:0.0:1787430836.482250:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847826688 00000100:00100000:0.0:1787430836.482264:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787430836.482270:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847825792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482320:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847825792:12345-0@lo:400:kworker.0 Request processed in 49us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430836.482326:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787430836.482340:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787430836.482345:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847825536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482370:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847825536:12345-0@lo:400:kworker.0 Request processed in 25us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430836.482374:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787430836.482392:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787430836.482398:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847826048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482427:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847826048:12345-0@lo:400:kworker.0 Request processed in 29us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430836.482432:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787430836.482443:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787430836.482449:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847826560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482477:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847826560:12345-0@lo:400:kworker.0 Request processed in 28us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430836.482483:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787430836.482494:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787430836.482500:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847826176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482525:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847826176:12345-0@lo:400:kworker.0 Request processed in 26us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430836.482530:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787430836.482540:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787430836.482546:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847826688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482572:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847826688:12345-0@lo:400:kworker.0 Request processed in 26us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430836.482578:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787430836.482805:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847827072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430836.482838:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787430836.482877:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04a44a80 x1874256847826176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430836.482890:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847826176:0@lo:400:kworker.0 00010000:00080000:0.0:1787430836.482910:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04a98a80 x1874256847826688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430836.482918:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847826688:0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482927:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847825536:0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482936:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b02b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847826048:0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.482946:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847826560:0@lo:400:kworker.0 00000100:00080000:0.0:1787430836.482980:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430836.482984:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430836.482999:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847825792:0@lo:400:kworker.0 00000100:00100000:0.0:1787430836.483017:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847827072 00000100:00100000:0.0:1787430836.483021:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847827072 00000100:00100000:0.0:1787430836.483056:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787430836.483063:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847827072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430836.483083:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430836.483117:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847827072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430836.483124:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787430836.483186:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847827072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430836.487916:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847827200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430836.487988:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430836.488238:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847827200 00000100:00100000:2.0:1787430836.488246:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847827200 00000100:00100000:2.0:1787430836.488294:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787430836.488304:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847827200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787430836.488325:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430836.488370:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847827200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430836.488387:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787430836.488506:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847827200:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1787430836.489578:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787430836.489592:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1787430836.489958:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847827328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430836.490018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430836.490196:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847827328 00000100:00100000:3.0:1787430836.490202:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847827328 00000100:00100000:3.0:1787430836.490252:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787430836.490263:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847827328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430836.490294:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430836.490338:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847827328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430836.490345:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787430836.490381:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847827328:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787430836.599487:0:14681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430836.599499:0:14681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430836.599521:0:14681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787430836.599528:0:14681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430836.815118:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430836.815188:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836255488 00000100:00100000:1.0:1787430836.815199:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836255488 00000100:00080000:0.0:1787430836.815273:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430836.815297:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:1.0:1787430836.815308:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:12372:x1874256836255488:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430836.815333:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430836.815355:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94cf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b29 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430836.815470:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94cf8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430836.815485:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430836.815498:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430836.815510:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787430836.815661:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94cf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b29 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430836.815683:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b29 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430836.815692:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430836.815695:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430836.815700:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030600, rc 0) 00000100:00100000:0.0:1787430836.815808:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12372:x1874256836255488:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 500us (699us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787430836.815816:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:0.0:1787430836.821636:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430836.821907:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836255616 00000100:00100000:2.0:1787430836.821919:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836255616 00000100:00100000:2.0:1787430836.821981:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 202 00000100:00100000:2.0:1787430836.821991:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12372:x1874256836255616:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:2.0:1787430836.822086:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822105:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822116:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822148:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822156:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822162:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822248:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822264:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822270:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430836.822318:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822331:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822337:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822344:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822349:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430836.822353:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822360:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822372:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430836.822375:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430836.822379:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822385:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94d06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822404:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822409:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822415:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822420:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430836.822423:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822429:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822437:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c11493900) 00010000:00010000:2.0:1787430836.822439:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430836.822442:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822447:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822461:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822467:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822472:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822484:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430836.822487:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822492:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822500:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430836.822502:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430836.822505:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430836.822510:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430836.822627:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b02b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12372:x1874256836255616:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 636us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430836.822635:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 202 00000100:00100000:1.0:1787430836.889978:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430836.890069:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836255872 00000100:00100000:0.0:1787430836.890080:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836255872 00000100:00100000:0.0:1787430836.890158:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 203 00000100:00100000:0.0:1787430836.890170:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+25:12375:x1874256836255872:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430836.890192:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430836.890215:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94d1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b30 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890292:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890308:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890319:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890334:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890341:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890369:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890549:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890569:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890577:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430836.890586:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787430836.890700:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890708:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890715:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890721:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430836.890725:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890732:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890744:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430836.890747:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430836.890758:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890764:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94d22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890779:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890785:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890790:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890794:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430836.890797:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890802:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890809:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b34f00) 00010000:00010000:0.0:1787430836.890811:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430836.890814:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890819:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890863:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94d1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 28 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890890:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 27 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430836.890898:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:0.0:1787430836.890900:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430836.890902:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175a00, rc 0) 00000100:00100000:0.0:1787430836.890970:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12375:x1874256836255872:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 802us (1006us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787430836.890978:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 203 00000100:00100000:2.0:1787430836.897061:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430836.897154:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836256000 00000100:00100000:3.0:1787430836.897165:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836256000 00000100:00100000:3.0:1787430836.897240:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 204 00000100:00100000:3.0:1787430836.897252:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12375:x1874256836256000:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1787430836.897327:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897343:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897355:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897408:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897414:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897420:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897426:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430836.897430:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897437:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897448:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:3.0:1787430836.897451:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430836.897455:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430836.897461:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430836.897626:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12375:x1874256836256000:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 350us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430836.897635:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 204 00000100:00100000:0.0:1787430836.907946:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430836.908031:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836256256 00000100:00100000:3.0:1787430836.908042:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836256256 00000100:00100000:3.0:1787430836.908104:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1787430836.908131:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12375:x1874256836256256:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1787430836.908379:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:12375:x1874256836256256:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 249us (456us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787430836.908388:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:2.0:1787430837.001354:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.001434:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836256512 00000100:00100000:3.0:1787430837.001446:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836256512 00000100:00100000:3.0:1787430837.001516:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 205 00000100:00100000:3.0:1787430837.001527:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:11899:x1874256836256512:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1787430837.001562:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430837.001584:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d45 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b37 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.001725:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.001740:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 29 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.001750:0:8819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.001785:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 29 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.001800:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 29 pid: 6499 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430837.001816:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847827456:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430837.001914:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430837.005362:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c11579880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847827456:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430837.005395:0:8819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.005777:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.005846:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836256640 00000100:00100000:3.0:1787430837.005853:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836256640 00010000:00010000:3.0:1787430837.005890:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 30 pid: 6499 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430837.005927:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 93 00000100:00100000:3.0:1787430837.005984:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:2400:x1874256836256640:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430837.005998:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430837.006005:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 30 pid: 6499 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.006017:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 30 pid: 6499 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.006040:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94d30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b30 expref: 30 pid: 6499 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.006056:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:3.0:1787430837.006061:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.006070:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.006078:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.006106:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430837.006171:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:2400:x1874256836256640:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 190us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430837.006179:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 93 00010000:00010000:0.0:1787430837.009536:0:8819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.009555:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430837.009580:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787430837.009754:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94d45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 30 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.009773:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 29 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.009782:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:0.0:1787430837.009785:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787430837.009789:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:0.0:1787430837.009868:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11899:x1874256836256512:12345-192.168.202.25@tcp:101:bash.0 Request processed in 8341us (8527us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787430837.009888:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 205 00000100:00100000:2.0:1787430837.013397:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.013724:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836256768 00000100:00100000:0.0:1787430837.013734:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836256768 00000100:00100000:0.0:1787430837.013800:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 206 00000100:00100000:0.0:1787430837.013812:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:11899:x1874256836256768:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430837.013839:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430837.013862:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94d5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b3e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.013900:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.013915:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.013926:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.014043:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94d5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b3e expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.014478:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b3e expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.014488:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:0.0:1787430837.014490:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787430837.014494:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175800, rc 0) 00000100:00100000:0.0:1787430837.014859:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11899:x1874256836256768:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1048us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.014876:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 206 00000100:00100000:2.0:1787430837.026590:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.027055:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836257024 00000100:00100000:3.0:1787430837.027067:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836257024 00000100:00100000:3.0:1787430837.027245:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 207 00000100:00100000:3.0:1787430837.027256:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:11899:x1874256836257024:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:3.0:1787430837.027499:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.027517:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.027529:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430837.027587:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1787430837.027806:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce60cdf1 reply state 0000000078184802 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.027821:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.027840:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:3.0:1787430837.027843:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430837.027848:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787430837.027893:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1787430837.027999:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11899:x1874256836257024:12345-192.168.202.25@tcp:36:bash.0 Request processed in 743us (1416us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787430837.028007:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 207 00000020:00080000:3.0:1787430837.028012:0:10098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787430837.035351:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.035439:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836257152 00000100:00100000:2.0:1787430837.035462:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836257152 00000100:00100000:2.0:1787430837.035521:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 208 00000100:00100000:2.0:1787430837.035532:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+34:11899:x1874256836257152:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430837.035563:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430837.035589:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94d6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b45 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.035689:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94d6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b45 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.035705:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94d6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b45 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.035772:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:0.0:1787430837.035776:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430837.035780:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02a00, rc 0) 00000100:00100000:0.0:1787430837.035845:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:11899:x1874256836257152:12345-192.168.202.25@tcp:101:bash.0 Request processed in 314us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.035853:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 208 00000100:00100000:2.0:1787430837.039483:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430837.039635:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836257280 00000100:00100000:1.0:1787430837.039645:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836257280 00000100:00100000:1.0:1787430837.039727:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:1.0:1787430837.039738:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:11899:x1874256836257280:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1787430837.039760:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430837.039786:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b4c expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430837.039813:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a07b1, atime: 0x6a8a07af, ctime: 0x6a8a07b1, blocks: 0x8 00010000:00010000:1.0:1787430837.039834:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1787430837.039839:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430837.039848:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.039867:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.039880:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00031600, rc 0) 00000100:00080000:0.0:1787430837.040180:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430837.040288:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:11899:x1874256836257280:12345-192.168.202.25@tcp:101:bash.0 Request processed in 549us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430837.040295:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:2.0:1787430837.043823:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.044000:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836257408 00000100:00100000:0.0:1787430837.044012:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836257408 00002000:00010000:0.0:1787430837.044056:0:8416:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787430837.044061:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b04c3b100 with x1874256836257408 ext(0->18446744073709551615) 00002000:00010000:0.0:1787430837.044074:0:8416:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b04c3b100. 00000100:00100000:0.0:1787430837.044111:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:0.0:1787430837.044151:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836257408:12345-192.168.202.25@tcp:10:bash.0 00002000:00010000:0.0:1787430837.044459:0:8416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787430837.044463:0:8416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787430833 -> 1787430837 00002000:00010000:0.0:1787430837.044466:0:8416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787430831 -> 1787430831 00002000:00010000:0.0:1787430837.044469:0:8416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787430833 -> 1787430837 00002000:00010000:0.0:1787430837.044471:0:8416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787430837.044545:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2399:x1874256836257408:12345-192.168.202.25@tcp:10:bash.0 Request processed in 413us (731us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787430837.044553:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00002000:00010000:0.0:1787430837.044557:0:8416:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787430837.044560:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b04c3b100 with x1874256836257408 ext(0->18446744073709551615) 00002000:00010000:0.0:1787430837.044575:0:8416:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b04c3b100. 00000100:00100000:3.0:1787430837.137593:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.137796:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836257536 00000100:00100000:2.0:1787430837.137807:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836257536 00000100:00100000:2.0:1787430837.137860:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 209 00000100:00100000:2.0:1787430837.137870:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:12389:x1874256836257536:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:2.0:1787430837.137940:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.137958:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.137969:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.137984:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138005:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138014:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138083:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138092:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138098:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430837.138164:0:13789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138175:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138182:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138188:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138194:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.138198:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138205:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138225:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430837.138228:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430837.138232:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138239:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94d7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138253:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138259:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138264:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138268:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.138272:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138277:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138284:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c11493000) 00010000:00010000:2.0:1787430837.138286:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430837.138289:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138294:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94d84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138317:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138324:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138329:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138334:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.138337:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138342:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138349:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:2.0:1787430837.138351:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430837.138353:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.138358:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.138433:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:12389:x1874256836257536:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 563us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.138441:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 209 00000100:00100000:2.0:1787430837.175546:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430837.177105:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836257792 00000100:00100000:1.0:1787430837.177136:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836257792 00000100:00100000:1.0:1787430837.177213:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 210 00000100:00100000:1.0:1787430837.177225:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+35:12392:x1874256836257792:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430837.177247:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430837.177270:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94d92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b53 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177364:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177380:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177392:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177406:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177413:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177420:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177532:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94da7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177543:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94da7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177551:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94da7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430837.177561:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787430837.177672:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177680:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177693:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177700:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00031a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430837.177705:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177712:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177725:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430837.177727:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430837.177732:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177738:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94d99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177752:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177758:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177764:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177769:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430837.177772:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177842:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177852:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430837.177854:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430837.177857:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177863:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94da0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177901:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94d92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b53 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177914:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94da7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b53 expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.177921:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:1.0:1787430837.177923:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787430837.177926:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ee400, rc 0) 00000100:00100000:1.0:1787430837.180420:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12392:x1874256836257792:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2882us (4580us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787430837.180436:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 210 00000100:00100000:3.0:1787430837.182701:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.183374:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836257920 00000100:00100000:0.0:1787430837.183384:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836257920 00000100:00100000:0.0:1787430837.183451:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00100000:0.0:1787430837.183462:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12392:x1874256836257920:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:0.0:1787430837.183540:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.183558:0:8819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 37 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.183568:0:8819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.183625:0:8819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 37 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.183640:0:8819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 37 pid: 8819 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430837.183654:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847827584:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430837.183756:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430837.186398:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8819:1874256847827584:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430837.186427:0:8819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430837.188219:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.188641:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836258176 00000100:00100000:2.0:1787430837.188650:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836258176 00000100:00100000:2.0:1787430837.188727:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:2.0:1787430837.188739:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:6159:x1874256836258176:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787430837.189454:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:6159:x1874256836258176:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 324us (850us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787430837.189465:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:3.0:1787430837.192772:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.192888:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836258304 00000100:00100000:0.0:1787430837.192899:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836258304 00010000:00010000:0.0:1787430837.192973:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 39 pid: 8819 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430837.193018:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00100000:0.0:1787430837.193029:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:2399:x1874256836258304:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430837.193045:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430837.193052:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 39 pid: 8819 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.193066:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 39 pid: 8819 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.193088:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94d4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b37 expref: 39 pid: 8819 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.193105:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:0.0:1787430837.193111:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.193138:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.193146:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.193179:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430837.193245:0:8819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430837.193247:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:2399:x1874256836258304:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 220us (484us total) trans 0 rc 0/0 00010000:00010000:2.0:1787430837.193254:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430837.193255:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 94 00010000:00010000:2.0:1787430837.193294:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.193302:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.193308:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.193313:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.193318:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.193325:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.193334:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:2.0:1787430837.193337:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430837.193340:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.193358:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94db5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.193402:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12392:x1874256836257920:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 9943us (10711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.193411:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00100000:1.0:1787430837.200486:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.200581:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836258560 00000100:00100000:0.0:1787430837.200592:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836258560 00000100:00100000:0.0:1787430837.200692:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:0.0:1787430837.200702:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+37:12392:x1874256836258560:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430837.200922:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:12392:x1874256836258560:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 221us (444us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787430837.200932:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00010000:00010000:2.0:1787430837.247788:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430837.280484:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.280582:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836258816 00000100:00100000:2.0:1787430837.280591:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836258816 00000100:00100000:2.0:1787430837.280680:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 212 00000100:00100000:2.0:1787430837.280692:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+38:12403:x1874256836258816:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:2.0:1787430837.280716:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430837.280738:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94dbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b5a expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.280820:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.280836:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.280848:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.280878:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.280885:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.280906:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281017:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94dd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281027:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281035:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430837.281045:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787430837.281160:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281169:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281177:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281183:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.281188:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281196:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281208:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430837.281211:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430837.281223:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281229:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94dc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281243:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281248:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281253:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281258:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.281261:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281266:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281274:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c11493000) 00010000:00010000:2.0:1787430837.281277:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430837.281279:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281284:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94dca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281324:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94dbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b5a expref: 41 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281352:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b5a expref: 40 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.281360:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:2.0:1787430837.281362:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430837.281365:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03400, rc 0) 00000100:00100000:2.0:1787430837.281440:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:12403:x1874256836258816:12345-192.168.202.25@tcp:101:cat.0 Request processed in 750us (964us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787430837.281448:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 212 00000100:00100000:1.0:1787430837.293181:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.294957:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836259072 00000100:00100000:2.0:1787430837.294970:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836259072 00000100:00100000:2.0:1787430837.295040:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1787430837.295051:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+40:12403:x1874256836259072:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:2.0:1787430837.295386:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+41:12403:x1874256836259072:12345-192.168.202.25@tcp:35:cat.0 Request processed in 335us (2215us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787430837.295393:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:1.0:1787430837.317405:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.317502:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836259328 00000100:00100000:3.0:1787430837.317513:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836259328 00000100:00100000:3.0:1787430837.317583:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 213 00000100:00100000:3.0:1787430837.317594:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+41:12404:x1874256836259328:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:3.0:1787430837.317690:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787430837.317716:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94d6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b45 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317740:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94dd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b5a expref: 40 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317752:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94da7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b53 expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317764:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94d61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b3e expref: 38 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317778:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:3.0:1787430837.317784:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430837.317813:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317827:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317858:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317873:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317880:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317887:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317967:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317975:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.317981:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430837.318237:0:10098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787430837.318250:0:10098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298790647909ns, next at 299790644474ns, rc = 0 00010000:00010000:3.0:1787430837.318301:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318310:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318317:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318335:0:10098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318342:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318348:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318367:0:10098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430837.318385:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318391:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318397:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318403:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430837.318408:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318415:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318423:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:3.0:1787430837.318426:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787430837.318429:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318443:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94ded lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318460:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318466:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318472:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318478:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430837.318481:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318485:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318494:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:3.0:1787430837.318496:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430837.318499:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318505:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94ddf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430837.318514:0:10098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047573f1c reply state 000000009fe30b4a transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318526:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.318539:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c1847b500) 00010000:00010000:3.0:1787430837.318542:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430837.318544:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430837.318661:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:12404:x1874256836259328:12345-192.168.202.25@tcp:36:rm.0 Request processed in 1067us (1265us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787430837.318668:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 213 00010000:00010000:0.0:1787430837.318890:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430837.318898:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.318905:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430837.318909:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.318915:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.318925:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:0.0:1787430837.318928:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787430837.318930:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.318936:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a600/0x4dbb683ba6a94df4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.318945:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430837.318947:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430837.318949:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430837.393702:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.393878:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836259584 00000100:00100000:2.0:1787430837.393891:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836259584 00000100:00100000:2.0:1787430837.393946:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 214 00000100:00100000:2.0:1787430837.393959:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+39:12409:x1874256836259584:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430837.393987:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430837.394012:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94dfb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b61 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394175:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394200:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394213:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394227:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394234:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394240:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430837.394662:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787430837.394814:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394823:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394831:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394860:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394868:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394876:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394891:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.394896:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394903:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394916:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430837.394919:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430837.394923:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394929:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94e02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430837.394942:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbb31464 reply state 000000005a9d99be transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394953:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.394958:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c1847b500) 00010000:00010000:2.0:1787430837.394960:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787430837.394963:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787430837.394992:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94dfb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.395005:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.395024:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430837.395026:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430837.395029:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02600, rc 0) 00000100:00100000:2.0:1787430837.395096:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:12409:x1874256836259584:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1138us (1405us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787430837.395104:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 214 00000100:00100000:1.0:1787430837.403450:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.403573:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836259712 00000100:00100000:2.0:1787430837.403583:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836259712 00000100:00100000:2.0:1787430837.403688:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:2.0:1787430837.403700:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2400:x1874256836259712:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430837.403719:0:8830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430837.403740:0:8830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b68 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430837.403767:0:8830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430837.403788:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=298s v=(0 0) 00010000:00010000:2.0:1787430837.403793:0:8830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430837.403803:0:8830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 6 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.403822:0:8830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 6 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.403835:0:8830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03000, rc 0) 00000100:00100000:2.0:1787430837.403887:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836259712:12345-192.168.202.25@tcp:101:bash.0 Request processed in 189us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.403909:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00080000:0.0:1787430837.403984:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430837.409451:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.409848:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836259840 00000100:00100000:2.0:1787430837.409860:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836259840 00000100:00100000:2.0:1787430837.409924:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:2.0:1787430837.409935:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:12409:x1874256836259840:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1787430837.409953:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430837.409971:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b6f expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.410002:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 7 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.410012:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430837.410017:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430837.410022:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.410057:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 7 pid: 8830 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.410072:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 7 pid: 8830 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.410087:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847827712:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430837.410362:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430837.416818:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8409:1874256847827712:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430837.416859:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.416881:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03c00, rc 0) 00000100:00100000:2.0:1787430837.416947:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:12409:x1874256836259840:12345-192.168.202.25@tcp:101:bash.0 Request processed in 7014us (7506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.416957:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:1.0:1787430837.419304:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.419470:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836259968 00000100:00100000:2.0:1787430837.419482:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836259968 00010000:00010000:2.0:1787430837.419533:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 7 pid: 8830 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.419595:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:2.0:1787430837.419648:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c115b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836259968:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430837.419664:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430837.419688:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 7 pid: 8830 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.419704:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 7 pid: 8830 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.419727:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94e1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b68 expref: 7 pid: 8830 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.419747:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430837.419766:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430837.419775:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.419786:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.419825:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.419839:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1874256847827840:192.168.202.25@tcp:105: 00000100:00100000:2.0:1787430837.419922:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430837.423401:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1874256847827840:192.168.202.25@tcp:105: 00010000:00010000:2.0:1787430837.423440:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430837.423583:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c115b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2399:x1874256836259968:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 3936us (4288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.423595:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:3.0:1787430837.431534:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.432485:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836260224 00000100:00100000:2.0:1787430837.432498:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836260224 00000100:00100000:2.0:1787430837.432574:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:2.0:1787430837.432586:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+42:12409:x1874256836260224:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:2.0:1787430837.432928:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:12409:x1874256836260224:12345-192.168.202.25@tcp:35:bash.0 Request processed in 343us (1403us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787430837.432936:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:1.0:1787430837.667648:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.667743:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836260352 00000100:00100000:2.0:1787430837.667755:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836260352 00000100:00100000:2.0:1787430837.667838:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 215 00000100:00100000:2.0:1787430837.667849:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+43:12426:x1874256836260352:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430837.667875:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430837.667896:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94e2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b76 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.667962:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.667977:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.667990:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430837.668037:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787430837.668041:0:13789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430837.668059:0:13789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.668083:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a94e2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b76 expref: 45 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.668100:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b76 expref: 44 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.668108:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:2.0:1787430837.668110:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430837.668114:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03400, rc 0) 00000100:00100000:2.0:1787430837.668195:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+44:12426:x1874256836260352:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 347us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.668209:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 215 00000100:00100000:1.0:1787430837.675634:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.675757:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836260608 00000100:00100000:3.0:1787430837.675767:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836260608 00000100:00100000:3.0:1787430837.675821:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 216 00000100:00100000:3.0:1787430837.675830:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+44:12426:x1874256836260608:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430837.675851:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430837.675871:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94e3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b7d expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.675985:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94e41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.675997:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94e41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.676008:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94e41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430837.676018:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787430837.676138:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94e3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b7d expref: 47 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.676174:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94e41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b7d expref: 46 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.676183:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:3.0:1787430837.676186:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430837.676188:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:3.0:1787430837.676248:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+46:12426:x1874256836260608:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 418us (649us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1787430837.676254:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 216 00000100:00100000:3.0:1787430837.686282:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.686329:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.686435:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836260864 00000100:00100000:2.0:1787430837.686446:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836260864 00000100:00100000:2.0:1787430837.686512:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 217 00000100:00100000:2.0:1787430837.686533:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+46:12426:x1874256836260864:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430837.686567:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430837.686588:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94e4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b84 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.686725:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94e56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.686739:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.686750:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430837.686763:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787430837.686867:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a94e4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b84 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.686885:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b84 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.686894:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430837.686897:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787430837.686901:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02200, rc 0) 00000100:00100000:2.0:1787430837.686978:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+48:12426:x1874256836260864:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 457us (704us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1787430837.686985:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 217 00000100:00100000:0.0:1787430837.687182:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836260992 00000100:00100000:0.0:1787430837.687187:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836260992 00000100:00100000:0.0:1787430837.687233:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1787430837.687242:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+48:2400:x1874256836260992:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430837.687253:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430837.687268:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8be00/0x4dbb683ba6a94e41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b7d expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.687280:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:0.0:1787430837.687283:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430837.687303:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+47:2400:x1874256836260992:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 63us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.687311:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:2.0:1787430837.706107:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430837.706280:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836261120 00000100:00100000:1.0:1787430837.706291:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836261120 00000100:00100000:1.0:1787430837.706368:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:1.0:1787430837.706381:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+6:2400:x1874256836261120:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:1.0:1787430837.706437:0:11754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.706462:0:11754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.706471:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787430837.706476:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430837.706481:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.706529:0:11754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 6 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.706558:0:11754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 6 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430837.706573:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11754:1874256847827968:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430837.706729:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430837.713646:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11754:1874256847827968:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430837.713679:0:11754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.725398:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.726149:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836261248 00000100:00100000:3.0:1787430837.726160:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836261248 00002000:00100000:3.0:1787430837.726218:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8e2b04c3bb80 x1874256836261248/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:58/0 lens 504/0 e 0 to 0 dl 1787430848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787430837.726231:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b04c3bb80 with x1874256836261248 ext(0->8) 00010000:00010000:3.0:1787430837.726244:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 7 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.726272:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 7 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430837.726280:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2b04c3bb80 00000100:00100000:3.0:1787430837.726317:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:3.0:1787430837.726327:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836261248:12345-192.168.202.25@tcp:4:lfs.0 00000100:00100000:3.0:1787430837.729594:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2400:x1874256836261248:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 3256us (4201us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787430837.735336:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00002000:00100000:3.0:1787430837.735359:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8e2b04c3bb80 x1874256836261248/t4294967309(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:58/0 lens 504/448 e 0 to 0 dl 1787430848 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787430837.735371:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b04c3bb80 with x1874256836261248 ext(0->8) 00010000:00010000:3.0:1787430837.735385:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 9 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430837.735484:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 9 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430837.735493:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e2b04c3bb80 00000100:00100000:3.0:1787430837.738498:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.741354:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836261376 00000100:00100000:0.0:1787430837.741370:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836261376 00010000:00010000:0.0:1787430837.741424:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 9 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430837.741470:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:0.0:1787430837.741482:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2401:x1874256836261376:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430837.741499:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787430837.741517:0:6483:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787430837.741534:0:6483:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787430837 00002000:00010000:0.0:1787430837.741537:0:6483:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787430837 00002000:00010000:0.0:1787430837.741538:0:6483:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787430837 00002000:00010000:0.0:1787430837.741540:0:6483:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787430837.741553:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 9 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.741583:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 9 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.741655:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d628104/0x4dbb683ba6a94e25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b6f expref: 9 pid: 8409 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.741672:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430837.741677:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430837.741683:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.741693:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.741718:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430837.741883:0:11754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741894:0:11754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741914:0:11754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741923:0:11754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741931:0:11754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741938:0:11754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eea00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430837.741942:0:11754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741951:0:11754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741976:0:11754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.741984:0:11754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a94e64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430837.742190:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2401:x1874256836261376:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 709us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.742199:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:1.0:1787430837.746852:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836261120:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 40459us (40741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430837.746867:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:1.0:1787430837.764999:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.765116:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836261632 00000100:00100000:0.0:1787430837.765160:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836261632 00000100:00100000:2.0:1787430837.765346:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:2.0:1787430837.765370:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c19996450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+47:12426:x1874256836261632:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:2.0:1787430837.765437:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b84 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430837.765660:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787430837.765697:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787430837.765974:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1787430837.766009:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.766020:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 51 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.766027:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.766051:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 51 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.766060:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 51 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.766071:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1874256847828096:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430837.766555:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430837.770576:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.770795:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1874256847828096:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430837.770821:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430837.772579:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836261760 00000100:00100000:1.0:1787430837.772592:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836261760 00010000:00010000:1.0:1787430837.772687:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 52 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430837.772738:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:1.0:1787430837.772750:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+52:2399:x1874256836261760:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430837.772766:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430837.772774:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 52 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.772788:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 52 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.772813:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a94e10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b61 expref: 52 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.772839:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:1.0:1787430837.772843:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.772850:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.772855:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.772878:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430837.772915:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.772923:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430837.772951:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+51:2399:x1874256836261760:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 203us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430837.772958:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 97 00000001:00080000:2.0:1787430837.773035:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1787430837.773182:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787430837.773278:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847828224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787430837.773331:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430837.773379:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430837.774018:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847828224 00000100:00100000:0.0:1787430837.774025:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847828224 00000100:00100000:0.0:1787430837.774071:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787430837.774082:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1874256847828224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787430837.774198:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1874256847828224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.774220:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787430837.774938:0:6500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1787430837.774944:0:6500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1787430837.774971:0:6500:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b04a12300, transno 4294967308 00000100:00100000:2.0:1787430837.774993:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847828224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787430837.775143:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1787430837.775212:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847828352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787430837.775252:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430837.775273:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430837.775341:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847828352 00000100:00100000:3.0:1787430837.775346:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847828352 00000100:00100000:3.0:1787430837.775398:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787430837.775407:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6500:x1874256847828352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430837.775513:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6500:x1874256847828352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (260us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787430837.775520:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787430837.775808:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b049a4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1874256847828352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787430837.775845:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787430837.775879:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.775888:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.775906:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.775911:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430837.775915:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.775922:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.775936:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430837.775939:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787430837.775944:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430837.775950:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94e6b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430837.776033:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787430837.776093:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787430837.776104:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 299248502595ns, next at 300248500115ns, rc = 0 00000001:00080000:2.0:1787430837.776185:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787430837.776209:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430837.776213:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787430837.776220:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a94e56 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b84 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430837.776369:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c19996450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:12426:x1874256836261632:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 11006us (11439us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787430837.776388:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000020:00080000:2.0:1787430837.776392:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787430837.780798:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430837.780910:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836261888 00000100:00100000:1.0:1787430837.780921:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836261888 00000100:00100000:1.0:1787430837.780988:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 218 00000100:00100000:1.0:1787430837.781000:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+54:12426:x1874256836261888:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430837.781025:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430837.781055:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a94e72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b8b expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.781109:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a94e72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b8b expref: 55 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.781142:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a94e72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b8b expref: 55 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.781183:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430837.781186:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430837.781189:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360eea00, rc 0) 00000100:00100000:1.0:1787430837.781245:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+55:12426:x1874256836261888:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 247us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430837.781251:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 218 00000100:00100000:2.0:1787430837.794178:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430837.794270:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836262144 00000100:00100000:3.0:1787430837.794281:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836262144 00000100:00100000:3.0:1787430837.794338:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:3.0:1787430837.794349:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+55:12426:x1874256836262144:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1787430837.794651:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+56:12426:x1874256836262144:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 302us (483us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787430837.794659:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:3.0:1787430837.909436:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.909588:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836262272 00000100:00100000:0.0:1787430837.909623:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836262272 00000100:00100000:0.0:1787430837.909701:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 219 00000100:00100000:0.0:1787430837.909713:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+56:12436:x1874256836262272:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:0.0:1787430837.909795:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909813:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909825:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909836:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909843:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909849:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909911:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909918:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.909924:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430837.909989:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910001:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910007:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910014:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910020:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430837.910024:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910031:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910044:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430837.910047:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430837.910051:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910058:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910073:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910078:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910091:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910097:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430837.910100:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910107:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910136:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c1847b500) 00010000:00010000:0.0:1787430837.910139:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430837.910143:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910149:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910160:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910165:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910169:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910174:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430837.910176:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910191:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910200:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430837.910202:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430837.910205:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.910210:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430837.910293:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+56:12436:x1874256836262272:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 582us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.910301:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 219 00000100:00100000:2.0:1787430837.957203:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430837.957316:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836262528 00000100:00100000:0.0:1787430837.957326:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836262528 00000100:00100000:0.0:1787430837.957390:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 220 00000100:00100000:0.0:1787430837.957401:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+56:12439:x1874256836262528:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430837.957424:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430837.957445:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b92 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957517:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957534:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957555:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957583:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957591:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957598:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957748:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957757:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957765:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430837.957774:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787430837.957852:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957859:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957865:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957870:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430837.957875:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957893:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957905:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430837.957909:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430837.957913:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957918:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94e95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957933:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957939:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957944:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957949:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430837.957952:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957956:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957963:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c1847b500) 00010000:00010000:0.0:1787430837.957966:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430837.957968:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.957983:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94e9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.958021:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94e8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.958036:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430837.958044:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430837.958046:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430837.958049:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175600, rc 0) 00000100:00100000:0.0:1787430837.958115:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+58:12439:x1874256836262528:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 716us (920us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787430837.958133:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 220 00000100:00100000:2.0:1787430837.963275:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430837.963375:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836262656 00000100:00100000:1.0:1787430837.963385:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836262656 00000100:00100000:1.0:1787430837.963440:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00100000:1.0:1787430837.963450:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+58:12439:x1874256836262656:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:1.0:1787430837.963512:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963529:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963541:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963580:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963586:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963593:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963627:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430837.963651:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963659:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963671:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430837.963674:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430837.963679:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430837.963685:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94eb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430837.963750:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+58:12439:x1874256836262656:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 300us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430837.963757:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00100000:3.0:1787430837.966055:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430837.966158:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836262912 00000100:00100000:2.0:1787430837.966169:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836262912 00000100:00100000:2.0:1787430837.966227:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:2.0:1787430837.966237:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+58:12439:x1874256836262912:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1787430837.966473:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:12439:x1874256836262912:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 237us (426us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787430837.966481:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:2.0:1787430838.049238:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.049328:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836263168 00000100:00100000:0.0:1787430838.049338:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836263168 00000100:00100000:0.0:1787430838.049422:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 222 00000100:00100000:0.0:1787430838.049434:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:12449:x1874256836263168:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430838.049458:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430838.049462:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787430838.049487:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94e33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b76 expref: 59 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.049506:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430838.049511:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430838.049533:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94eb8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138b99 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787430838.049727:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787430838.049903:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.049918:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.049927:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.049960:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.049974:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 59 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.049988:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847828480:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430838.050083:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430838.052964:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430838.053184:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836263296 00000100:00100000:3.0:1787430838.053196:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836263296 00010000:00010000:3.0:1787430838.053239:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 60 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.053283:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 98 00000100:00100000:3.0:1787430838.053294:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:2400:x1874256836263296:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430838.053307:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430838.053314:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 60 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.053328:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 60 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.053351:0:9495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:3.0:1787430838.053356:0:9495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.053366:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.053389:0:9495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.053407:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430838.053469:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:2400:x1874256836263296:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 177us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430838.053478:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 98 00010000:00010000:0.0:1787430838.055222:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94ea3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b92 expref: 59 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.055247:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847828480:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430838.055272:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.055282:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.055304:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430838.055324:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787430838.055466:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175800/0x4dbb683ba6a94eb8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 60 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.055481:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 59 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.055490:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.055493:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787430838.055496:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174000, rc 0) 00000100:00100000:0.0:1787430838.059818:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:12449:x1874256836263168:12345-192.168.202.25@tcp:101:bash.0 Request processed in 10371us (10573us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787430838.059833:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 222 00000100:00100000:2.0:1787430838.079010:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.079328:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836263424 00000100:00100000:0.0:1787430838.079339:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836263424 00000100:00100000:0.0:1787430838.079393:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 223 00000100:00100000:0.0:1787430838.079405:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+59:12449:x1874256836263424:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430838.079432:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430838.079454:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ecd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ba0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.079496:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.079554:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.079567:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.079725:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ecd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.079747:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.079757:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.079760:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787430838.079764:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175a00, rc 0) 00000100:00100000:0.0:1787430838.079820:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:12449:x1874256836263424:12345-192.168.202.25@tcp:101:bash.0 Request processed in 417us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430838.079827:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 223 00000100:00100000:1.0:1787430838.085674:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.085849:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836263680 00000100:00100000:2.0:1787430838.085859:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836263680 00000100:00100000:2.0:1787430838.085923:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 224 00000100:00100000:2.0:1787430838.085935:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+60:12449:x1874256836263680:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:2.0:1787430838.086182:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.086202:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.086214:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430838.086275:0:13789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1787430838.086298:0:13789:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098f513aa reply state 00000000e45c19f1 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.086313:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.086320:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:2.0:1787430838.086323:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787430838.086326:0:13789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430838.086425:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:12449:x1874256836263680:12345-192.168.202.25@tcp:36:bash.0 Request processed in 491us (761us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787430838.086433:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 224 00000020:00080000:2.0:1787430838.086438:0:13789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787430838.092896:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.100293:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836263808 00000100:00100000:1.0:1787430838.100307:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836263808 00000100:00100000:1.0:1787430838.100380:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 225 00000100:00100000:1.0:1787430838.100391:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:12449:x1874256836263808:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1787430838.100415:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430838.100440:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ee2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ba7 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.100529:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.100746:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 64 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.100770:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.100815:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 64 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.100828:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 64 pid: 10098 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.100841:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1874256847828608:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430838.100949:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430838.103444:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1874256847828608:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430838.103475:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.103958:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.104302:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836263936 00000100:00100000:0.0:1787430838.104311:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836263936 00010000:00010000:0.0:1787430838.104355:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 65 pid: 10098 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.104399:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 99 00000100:00100000:0.0:1787430838.104410:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:2400:x1874256836263936:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430838.104454:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430838.104464:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 65 pid: 10098 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.104484:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 65 pid: 10098 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.104507:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ebf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b99 expref: 65 pid: 10098 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.104528:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.104533:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.104554:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.104562:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.104815:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430838.104879:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+64:2400:x1874256836263936:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 468us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430838.104886:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 99 00010000:00010000:1.0:1787430838.110141:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.110160:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430838.110224:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787430838.110230:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787430838.110263:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.110307:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94ee2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 64 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.110330:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.110360:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.110363:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430838.110367:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c00030c00, rc 0) 00000100:00100000:1.0:1787430838.110450:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:12449:x1874256836263808:12345-192.168.202.25@tcp:101:bash.0 Request processed in 10059us (17562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.110458:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 225 00000100:00100000:2.0:1787430838.114816:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.114899:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836264192 00000100:00100000:0.0:1787430838.114908:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836264192 00000100:00100000:0.0:1787430838.114969:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1787430838.114981:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+63:12449:x1874256836264192:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:0.0:1787430838.115233:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+64:12449:x1874256836264192:12345-192.168.202.25@tcp:35:bash.0 Request processed in 253us (634us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1787430838.115242:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:2.0:1787430838.226495:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.226592:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836264320 00000100:00100000:0.0:1787430838.226785:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836264320 00000100:00100000:0.0:1787430838.226869:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 226 00000100:00100000:0.0:1787430838.226881:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+64:12455:x1874256836264320:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430838.226911:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430838.226935:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ef0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bae expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.227008:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ef7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.227024:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.227036:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430838.227083:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787430838.227087:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430838.227234:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.227262:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174000/0x4dbb683ba6a94ef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bae expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.227284:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bae expref: 65 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.227292:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430838.227296:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430838.227314:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174600, rc 0) 00000100:00100000:0.0:1787430838.227378:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:12455:x1874256836264320:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 498us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430838.227386:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 226 00000100:00100000:3.0:1787430838.229988:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.230082:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836264448 00000100:00100000:1.0:1787430838.230092:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836264448 00000100:00100000:1.0:1787430838.230157:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 227 00000100:00100000:1.0:1787430838.230169:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:12455:x1874256836264448:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430838.230191:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430838.230209:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94efe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bb5 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230269:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230283:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230294:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230307:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230315:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230340:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230417:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230426:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230432:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430838.230467:0:13789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787430838.230470:0:13789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787430838.230485:0:13789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230495:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230503:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230509:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230515:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230521:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.230525:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230538:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230561:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430838.230564:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430838.230569:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230575:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030800/0x4dbb683ba6a94f05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230589:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230595:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230816:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230824:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.230827:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230834:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230843:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c1847b500) 00010000:00010000:1.0:1787430838.230846:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430838.230848:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230863:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a94f0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230889:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031a00/0x4dbb683ba6a94efe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bb5 expref: 67 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230902:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bb5 expref: 66 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.230909:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.230911:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430838.230913:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5400, rc 0) 00000100:00100000:1.0:1787430838.230966:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12455:x1874256836264448:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 798us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.230973:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 227 00000100:00100000:2.0:1787430838.238023:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.238067:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.238157:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836264832 00000100:00100000:1.0:1787430838.238167:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836264832 00000100:00100000:1.0:1787430838.238237:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1787430838.238247:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:2400:x1874256836264832:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430838.238261:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430838.238287:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bb5 expref: 66 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.238307:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.238312:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430838.238374:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:2400:x1874256836264832:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 128us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.238398:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:3.0:1787430838.239100:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836264704 00000100:00100000:3.0:1787430838.239117:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836264704 00000100:00100000:3.0:1787430838.239173:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 228 00000100:00100000:3.0:1787430838.239182:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:12455:x1874256836264704:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430838.239200:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430838.239218:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94f1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bbc expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.239341:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.239356:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.239366:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.239402:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.239425:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 66 pid: 6498 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.239439:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847828736:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430838.239572:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430838.253051:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.253761:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836264960 00000100:00100000:1.0:1787430838.253772:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836264960 00010000:00010000:1.0:1787430838.253814:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 67 pid: 6498 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.253862:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 100 00000100:00100000:1.0:1787430838.253872:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c115b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:2399:x1874256836264960:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430838.253885:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430838.253893:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 67 pid: 6498 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.253907:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 67 pid: 6498 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.253927:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.253933:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.253942:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.253950:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.253969:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430838.254024:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c115b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:2399:x1874256836264960:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 153us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.254047:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 100 00010000:00010000:3.0:1787430838.259419:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030c00/0x4dbb683ba6a94ee9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba7 expref: 66 pid: 6498 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.259450:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847828736:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430838.259476:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.259522:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.259530:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430838.259552:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787430838.261209:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b800/0x4dbb683ba6a94f1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 67 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.261237:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 66 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.261247:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:3.0:1787430838.261263:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430838.261267:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a200, rc 0) 00000100:00100000:3.0:1787430838.261342:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12455:x1874256836264704:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 22160us (23329us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787430838.261351:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 228 00000100:00100000:2.0:1787430838.267389:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.268793:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836265216 00000100:00100000:0.0:1787430838.268806:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836265216 00000100:00100000:0.0:1787430838.268899:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:0.0:1787430838.268911:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12455:x1874256836265216:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:0.0:1787430838.268926:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430838.268955:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a94e72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b8b expref: 66 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.268977:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.268982:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430838.269050:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:12455:x1874256836265216:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 141us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430838.269057:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00010000:00010000:3.0:1787430838.272995:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430838.280159:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.283361:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836265344 00000100:00100000:1.0:1787430838.283376:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836265344 00000100:00100000:1.0:1787430838.283451:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 229 00000100:00100000:1.0:1787430838.283463:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:12455:x1874256836265344:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:1.0:1787430838.283595:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.283661:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.283673:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430838.283784:0:8819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787430838.283876:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:12455:x1874256836265344:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 415us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.283885:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 229 00000100:00100000:3.0:1787430838.286207:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.286304:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836265472 00000100:00100000:1.0:1787430838.286316:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836265472 00000100:00100000:1.0:1787430838.286377:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 230 00000100:00100000:1.0:1787430838.286389:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+65:12455:x1874256836265472:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430838.286411:0:13789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430838.286431:0:13789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bc3 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.286483:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.286512:0:13789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 66 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.286533:0:13789:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.286547:0:13789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 66 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.286560:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.286564:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430838.286567:0:13789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 66 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.286575:0:13789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5c00, rc 0) 00000100:00100000:1.0:1787430838.286902:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12455:x1874256836265472:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 514us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.286910:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 230 00000040:00080000:0.0:1787430838.655891:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430838.655902:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430838.655933:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787430838.655948:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430838.656139:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b048fdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847828864:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787430838.656323:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430838.661073:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b048fdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847828864:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430838.665280:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.665810:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836265600 00000100:00100000:1.0:1787430838.665822:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836265600 00000100:00100000:1.0:1787430838.665892:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00100000:1.0:1787430838.665905:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12456:x1874256836265600:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787430838.665947:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787430838.666098:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12456:x1874256836265600:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 196us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.666107:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00100000:0.0:1787430838.674247:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.674350:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836265728 00000100:00100000:1.0:1787430838.674376:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836265728 00000100:00100000:1.0:1787430838.674452:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 232 00000100:00100000:1.0:1787430838.674464:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12456:x1874256836265728:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787430838.674571:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674589:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674643:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674663:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674672:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674678:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674708:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674719:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674725:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430838.674777:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787430838.674798:0:8819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787430838.674811:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674824:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674831:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674838:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674843:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.674848:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674855:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674868:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:1.0:1787430838.674871:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430838.674875:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674880:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674892:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674897:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674915:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674920:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.674923:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674929:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674938:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8e2b0353fe00) 00010000:00010000:1.0:1787430838.674940:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430838.674943:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674948:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674963:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674969:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674974:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674979:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.674981:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.674996:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.675004:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.675006:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430838.675009:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.675014:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.675217:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12456:x1874256836265728:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 752us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.675225:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 232 00000100:00100000:2.0:1787430838.694873:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.695345:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836265984 00000100:00100000:0.0:1787430838.695357:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836265984 00000100:00100000:0.0:1787430838.695450:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 233 00000100:00100000:0.0:1787430838.695462:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+66:12456:x1874256836265984:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430838.695485:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430838.695505:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bca expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695672:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695692:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695704:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430838.695715:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787430838.695809:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695817:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695824:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695830:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.695835:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695842:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695869:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.695872:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787430838.695877:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695883:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695928:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f52 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bca expref: 68 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695940:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:0.0:1787430838.695943:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430838.695946:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bca expref: 68 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.695960:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175600, rc 0) 00000100:00100000:0.0:1787430838.696038:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:12456:x1874256836265984:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 579us (1177us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1787430838.696045:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 233 00000100:00100000:3.0:1787430838.700059:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.700234:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836266112 00000100:00100000:1.0:1787430838.700246:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836266112 00000100:00100000:1.0:1787430838.700322:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 234 00000100:00100000:1.0:1787430838.700335:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:12456:x1874256836266112:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787430838.700393:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787430838.700528:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:12456:x1874256836266112:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 195us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.700536:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 234 00000100:00100000:3.0:1787430838.709558:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.710946:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836266368 00000100:00100000:1.0:1787430838.710959:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836266368 00000100:00100000:1.0:1787430838.711034:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 235 00000100:00100000:1.0:1787430838.711044:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:12456:x1874256836266368:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430838.711064:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430838.711081:0:8819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787430838.711143:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94ef7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bae expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.711170:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430838.711176:0:8819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430838.711192:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f67 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bd1 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430838.712843:0:8819:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787430838.713025:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.713041:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.713053:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.714707:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd1 expref: 69 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.714738:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd1 expref: 68 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.714749:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353fe00) 00010000:00010000:1.0:1787430838.714752:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430838.714755:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5600, rc 0) 00000100:00100000:1.0:1787430838.714840:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:12456:x1874256836266368:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 3797us (5291us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787430838.714868:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 235 00000100:00100000:2.0:1787430838.718028:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.718223:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836266624 00000100:00100000:0.0:1787430838.718234:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836266624 00000100:00100000:0.0:1787430838.718291:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 236 00000100:00100000:0.0:1787430838.718302:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:12456:x1874256836266624:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430838.718407:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430838.718433:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a94f6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd1 expref: 68 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718466:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353fe00) 00010000:00010000:0.0:1787430838.718478:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430838.718499:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718512:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718522:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718558:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718566:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718573:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718780:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718788:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718795:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718801:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.718806:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718821:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718831:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:0.0:1787430838.718833:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.718838:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718844:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718857:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718864:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718870:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718875:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.718878:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718883:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718890:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xef9e2a8d (ffff8e2b03b34f00) 00010000:00010000:0.0:1787430838.718892:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.718895:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.718912:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f83 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xef9e2a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.719007:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:12456:x1874256836266624:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 706us (987us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430838.719014:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 236 00000100:00100000:3.0:1787430838.736188:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.736304:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836266752 00000100:00100000:1.0:1787430838.736314:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836266752 00000100:00100000:1.0:1787430838.736373:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 237 00000100:00100000:1.0:1787430838.736384:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+67:12456:x1874256836266752:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430838.736405:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430838.736428:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bd8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.736467:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.736480:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.736493:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.736669:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94f8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 69 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.736690:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.736698:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:1.0:1787430838.736701:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787430838.736705:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5200, rc 0) 00000100:00100000:1.0:1787430838.736773:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:12456:x1874256836266752:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 391us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.736788:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 237 00000100:00100000:3.0:1787430838.739596:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.745917:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836267008 00000100:00100000:0.0:1787430838.745932:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836267008 00000100:00100000:0.0:1787430838.746009:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:0.0:1787430838.746021:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+68:12456:x1874256836267008:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430838.746113:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.746149:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.746161:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430838.746337:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787430838.746347:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300218745008ns, next at 301218742308ns, rc = 0 00000004:00010000:0.0:1787430838.746398:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4a0d676 reply state 000000003266c8ce transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.746412:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.746420:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:0.0:1787430838.746436:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787430838.746441:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430838.746560:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+70:12456:x1874256836267008:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 540us (6972us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787430838.746569:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:2.0:1787430838.758291:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.758354:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836267136 00000100:00100000:0.0:1787430838.758365:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836267136 00000100:00100000:0.0:1787430838.758431:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:0.0:1787430838.758443:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+70:12456:x1874256836267136:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430838.758472:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430838.758495:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bdf expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.758554:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 71 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.758570:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 71 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.758592:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:0.0:1787430838.758595:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430838.758719:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175600, rc 0) 00000100:00100000:1.0:1787430838.758820:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+71:12456:x1874256836267136:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 377us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.758837:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:3.0:1787430838.762779:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.763001:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836267264 00000100:00100000:2.0:1787430838.763011:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836267264 00000100:00100000:2.0:1787430838.763072:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:2.0:1787430838.763083:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2399:x1874256836267264:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787430838.763492:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:2399:x1874256836267264:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 409us (720us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787430838.763500:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:3.0:1787430838.767399:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.767660:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836267520 00000100:00100000:2.0:1787430838.767671:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836267520 00000100:00100000:2.0:1787430838.767745:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:2.0:1787430838.767757:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+71:12456:x1874256836267520:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787430838.768008:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+72:12456:x1874256836267520:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 254us (619us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787430838.768016:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:3.0:1787430838.772480:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.772992:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836267776 00000100:00100000:1.0:1787430838.773003:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836267776 00000100:00100000:1.0:1787430838.773064:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:1.0:1787430838.773075:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+72:12456:x1874256836267776:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787430838.773203:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+72:12456:x1874256836267776:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 129us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.773211:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:3.0:1787430838.775997:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.776166:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836267904 00000100:00100000:1.0:1787430838.776175:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836267904 00000100:00100000:1.0:1787430838.776239:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:1.0:1787430838.776249:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+72:12456:x1874256836267904:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430838.776267:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430838.776297:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94fa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138be6 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.776488:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4600/0x4dbb683ba6a94fad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.776502:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4600/0x4dbb683ba6a94fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.776512:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4600/0x4dbb683ba6a94fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430838.776669:0:8819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787430838.776688:0:8819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4600/0x4dbb683ba6a94fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.776715:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a94fa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138be6 expref: 74 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.776745:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4600/0x4dbb683ba6a94fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138be6 expref: 73 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.776755:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:1.0:1787430838.776758:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787430838.776762:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4600, rc 0) 00000100:00100000:1.0:1787430838.777246:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+73:12456:x1874256836267904:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 996us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.777254:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:0.0:1787430838.786851:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430838.787139:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836268032 00000100:00100000:3.0:1787430838.787151:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836268032 00000100:00100000:3.0:1787430838.787217:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:3.0:1787430838.787228:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+10:2400:x1874256836268032:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430838.787246:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430838.787265:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bed expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430838.787304:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a07b6, blocks: 0x0 00010000:00010000:3.0:1787430838.787322:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1787430838.787326:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430838.787355:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.787377:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.787392:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:3.0:1787430838.787552:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:2400:x1874256836268032:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 324us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430838.787560:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:3.0:1787430838.796364:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.796461:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836268288 00000100:00100000:1.0:1787430838.796471:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836268288 00000100:00100000:1.0:1787430838.796542:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 242 00000100:00100000:1.0:1787430838.796553:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+73:12456:x1874256836268288:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787430838.796684:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+73:12456:x1874256836268288:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.796692:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 242 00000100:00100000:1.0:1787430838.800072:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.800183:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836268416 00000100:00100000:2.0:1787430838.800193:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836268416 00000100:00100000:2.0:1787430838.800254:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:2.0:1787430838.800265:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+11:12456:x1874256836268416:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430838.800293:0:11754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430838.800312:0:11754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bf4 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.800343:0:11754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 12 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.800371:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430838.800376:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430838.800382:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 12 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.800420:0:11754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 12 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.800434:0:11754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 12 pid: 8409 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.800448:0:11754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11754:1874256847828992:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430838.800578:0:11754:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787430838.811312:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430838.811642:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836268544 00000100:00100000:3.0:1787430838.811655:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836268544 00010000:00010000:3.0:1787430838.811701:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 13 pid: 8409 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.811746:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:3.0:1787430838.811758:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c04e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2400:x1874256836268544:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430838.811772:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430838.811795:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 13 pid: 8409 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.811810:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 13 pid: 8409 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.811835:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430838.811854:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430838.811863:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 13 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.811873:0:9495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 13 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.811911:0:9495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 13 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.811926:0:9495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9495:1874256847829120:192.168.202.25@tcp:105: 00000100:00100000:3.0:1787430838.812463:0:9495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211a900 going to sleep for 11 seconds 00010000:00010000:2.0:1787430838.812999:0:11754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f85e653/0x4dbb683ba6a94fb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bed expref: 13 pid: 8409 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.813016:0:11754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11754:1874256847828992:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430838.813043:0:11754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 12 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.813054:0:11754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03000, rc 0) 00000100:00100000:2.0:1787430838.813085:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:12456:x1874256836268416:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 12822us (13023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430838.813107:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:0.0:1787430838.817191:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.817390:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836268672 00000100:00100000:2.0:1787430838.817400:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836268672 00002000:00100000:2.0:1787430838.817444:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8e2b048fdc00 x1874256836268672/t0(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:59/0 lens 504/0 e 0 to 0 dl 1787430849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430838.817466:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b048fdc00 with x1874256836268672 ext(0->12) 00002000:00010000:2.0:1787430838.817471:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b048fdc00 00000100:00100000:2.0:1787430838.817501:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:2.0:1787430838.817511:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:2399:x1874256836268672:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787430838.818858:0:9495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9495:1874256847829120:192.168.202.25@tcp:105: 00010000:00010000:3.0:1787430838.818882:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430838.818941:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c04e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+14:2400:x1874256836268544:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 7185us (7642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430838.818950:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:2.0:1787430838.820915:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2399:x1874256836268672:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 3398us (3726us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787430838.820928:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00002000:00100000:2.0:1787430838.820941:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8e2b048fdc00 x1874256836268672/t4294967321(0) o4->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:59/0 lens 504/448 e 0 to 0 dl 1787430849 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430838.820951:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b048fdc00 with x1874256836268672 ext(0->12) 00002000:00010000:2.0:1787430838.820957:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b048fdc00 00000100:00100000:0.0:1787430838.828362:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.828474:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836268800 00000100:00100000:1.0:1787430838.828497:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836268800 00000100:00100000:1.0:1787430838.828566:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 243 00000100:00100000:1.0:1787430838.828576:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+73:12456:x1874256836268800:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787430838.834414:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1787430838.834436:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787430838.834483:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787430838.834507:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2b04a6cb40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787430838.834511:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b04a6c540 00000020:00080000:3.0:1787430838.834514:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2c10b16c00 00000004:00080000:3.0:1787430838.834549:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787430838.834569:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2b04a6c300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787430838.834571:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b04a6c600 00000020:00080000:3.0:1787430838.834589:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c35eb3600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2c1adbb200 00000020:00080000:3.0:1787430838.834637:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787430838.834702:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787430838.835061:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847829248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787430838.835152:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430838.835346:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847829248 00000100:00100000:2.0:1787430838.835354:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847829248 00000100:00100000:2.0:1787430838.835424:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787430838.835436:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847829248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787430838.835464:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787430838.835489:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.835526:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 12 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.835557:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787430838.835562:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430838.835567:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.835598:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 12 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.835637:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 12 pid: 8411 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.835649:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847829504:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430838.835708:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787430838.836485:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12456:x1874256836268800:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 7909us (8131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.836495:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 243 00010000:00010000:0.0:1787430838.837092:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837104:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837141:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837147:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.837152:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837160:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837176:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e2c11493600) 00010000:00010000:0.0:1787430838.837179:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.837182:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837188:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175200/0x4dbb683ba6a94cc0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837214:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837220:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837225:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837229:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.837232:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837248:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837256:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e2b03b34000) 00010000:00010000:0.0:1787430838.837258:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.837261:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837276:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a94d68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837293:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837299:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837305:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837309:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8aa00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.837312:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837318:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837324:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c1847b500) 00010000:00010000:0.0:1787430838.837326:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.837329:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837340:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8aa00/0x4dbb683ba6a94de6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837351:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837357:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837363:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837368:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.837371:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837376:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837383:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2c1847b500) 00010000:00010000:0.0:1787430838.837385:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.837388:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837393:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a94e09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837405:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837412:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837423:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837428:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.837431:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837436:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837444:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.837446:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.837449:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837455:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a94edb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837466:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837472:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837477:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837481:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.837484:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837502:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837513:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:0.0:1787430838.837515:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787430838.837518:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.837523:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174c00/0x4dbb683ba6a94f98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.837561:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847829376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787430838.837647:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430838.837676:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430838.837683:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847829632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787430838.837708:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430838.837745:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847829376 00000100:00100000:0.0:1787430838.837752:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847829376 00000100:00100000:0.0:1787430838.837852:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847829632 00000100:00100000:0.0:1787430838.837856:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847829632 00000100:00100000:0.0:1787430838.837876:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430838.837885:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847829376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787430838.838001:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787430838.838005:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787430838 00002000:00010000:0.0:1787430838.838007:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787430838.838010:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787430838 -> 1787430838 00002000:00010000:0.0:1787430838.838012:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787430838.838047:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3629:x1874256847829376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (400us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787430838.838061:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430838.838078:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430838.838085:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847829632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787430838.838100:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1787430838.838135:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a07b5, atime: 0x6a8a07b5, ctime: 0x6a8a07b5, blocks: 0x8 00010000:00010000:0.0:1787430838.838142:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838155:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1787430838.838159:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430838.838165:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838178:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838187:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838195:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838210:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787430838.838295:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847829632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 211us (586us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787430838.838301:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:0.0:1787430838.838325:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430838.838330:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838339:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430838.838342:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838350:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838363:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838370:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d0b5ed/0x4dbb683ba6a94fc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.838387:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430838.838389:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430838.838391:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787430838.838420:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b03e57b80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787430838.838426:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847829632:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1787430838.838437:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b04c33800/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787430838.838441:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847829376:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787430838.840744:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430838.840753:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430838.843513:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.844003:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.844033:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836269056 00000100:00100000:0.0:1787430838.844047:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836269056 00010000:00010000:0.0:1787430838.844082:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 13 pid: 8411 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.844136:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:0.0:1787430838.844147:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2399:x1874256836269056:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430838.844161:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430838.844167:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 13 pid: 8411 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.844182:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 13 pid: 8411 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.844207:0:10313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430838.844211:0:10313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430838.844218:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.844228:0:10313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.844248:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430838.844370:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+13:2399:x1874256836269056:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 223us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430838.844377:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 102 00010000:00010000:2.0:1787430838.845241:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2b4288/0x4dbb683ba6a94d76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b4c expref: 12 pid: 8411 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.845260:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1874256847829504:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430838.845294:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.845305:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.845325:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.845336:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.845345:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.845370:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787430838.845544:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3628:x1874256847829248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10097us (10379us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787430838.845552:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787430838.845573:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836268928 00000100:00100000:2.0:1787430838.845577:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836268928 00000100:00100000:2.0:1787430838.845632:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:2.0:1787430838.845640:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b048fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+12:2399:x1874256836268928:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1787430838.846156:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b04c33b80/2, rc 0, transno 4294967323 00000100:00100000:3.0:1787430838.846164:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847829248:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787430838.846785:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430838.846794:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.846828:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430838.846834:0:10372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.846846:0:10372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.846865:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.846872:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff5074c/0x4dbb683ba6a94fc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.846891:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430838.846894:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430838.846895:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787430838.850156:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1787430838.850175:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1787430838.850427:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b048fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836268928:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 4781us (6917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430838.850438:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:0.0:1787430838.857243:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.857505:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836269312 00000100:00100000:2.0:1787430838.857515:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836269312 00000100:00100000:2.0:1787430838.857596:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 244 00000100:00100000:2.0:1787430838.857650:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12456:x1874256836269312:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787430838.857720:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430838.857747:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4600/0x4dbb683ba6a94fad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138be6 expref: 21 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.857766:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:2.0:1787430838.857771:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430838.857928:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.857944:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.857955:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430838.858076:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fc1c4b8 reply state 000000006b5cead6 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.858090:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.858097:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:2.0:1787430838.858214:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787430838.858217:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430838.858430:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12456:x1874256836269312:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 782us (1195us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787430838.858438:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 244 00000100:00100000:1.0:1787430838.864684:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430838.864770:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836269440 00000100:00100000:3.0:1787430838.864780:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836269440 00000100:00100000:3.0:1787430838.864848:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:3.0:1787430838.864858:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2399:x1874256836269440:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787430838.865023:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787430838.865027:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787430838 -> 1787430838 00002000:00010000:3.0:1787430838.865030:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787430837 00002000:00010000:3.0:1787430838.865032:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787430838 -> 1787430838 00002000:00010000:3.0:1787430838.865034:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787430838.865257:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2399:x1874256836269440:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 399us (580us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787430838.865265:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:0.0:1787430838.869342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.869563:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836269696 00000100:00100000:1.0:1787430838.869574:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836269696 00000100:00100000:1.0:1787430838.869669:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 245 00000100:00100000:1.0:1787430838.869681:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:12456:x1874256836269696:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787430838.869753:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.869770:0:13789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.869780:0:13789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.869841:0:13789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.869856:0:13789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 22 pid: 6498 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.869872:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13789:1874256847829760:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430838.869976:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430838.872677:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.872762:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836269824 00000100:00100000:2.0:1787430838.872771:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836269824 00010000:00010000:2.0:1787430838.872809:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 23 pid: 6498 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.872866:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:2.0:1787430838.872877:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2399:x1874256836269824:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430838.872891:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430838.872899:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 23 pid: 6498 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.872912:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 23 pid: 6498 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.872935:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:2.0:1787430838.872940:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.872950:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.872958:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.872975:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430838.873029:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+23:2399:x1874256836269824:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 154us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430838.873038:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 103 00010000:00010000:1.0:1787430838.874580:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5200/0x4dbb683ba6a94f91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bd8 expref: 22 pid: 6498 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.874655:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13789:1874256847829760:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430838.874678:0:13789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874689:0:13789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874695:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874730:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874737:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874744:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874750:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.874754:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874761:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874778:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:1.0:1787430838.874796:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787430838.874802:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.874808:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4000/0x4dbb683ba6a94fd7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.874880:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12456:x1874256836269696:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 5200us (5549us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787430838.874889:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 245 00000100:00100000:0.0:1787430838.881210:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430838.881396:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836269952 00000100:00100000:3.0:1787430838.881407:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836269952 00000100:00100000:3.0:1787430838.881480:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:3.0:1787430838.881491:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836269952:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787430838.881571:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.881593:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 8 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.881641:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430838.881647:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430838.881652:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.881690:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 8 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.881711:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 8 pid: 11754 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.881726:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1874256847829888:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430838.881808:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430838.884757:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.884875:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1874256847829888:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430838.884905:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.884994:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836270080 00000100:00100000:2.0:1787430838.885003:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836270080 00010000:00010000:2.0:1787430838.885039:0:9495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 9 pid: 11754 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.885112:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:2.0:1787430838.885133:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+9:2400:x1874256836270080:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430838.885148:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430838.885171:0:9495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 9 pid: 11754 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.885184:0:9495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 9 pid: 11754 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.885207:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007deb7e2d/0x4dbb683ba6a94fbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bf4 expref: 9 pid: 11754 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.885223:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430838.885227:0:9495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430838.885233:0:9495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.885243:0:9495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.885280:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430838.885330:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836270080:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 199us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430838.885338:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 104 00010000:00010000:3.0:1787430838.885674:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885685:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885717:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885726:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885735:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885743:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430838.885748:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885755:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885767:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.885774:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004767eb6/0x4dbb683ba6a94fde lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.885873:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836269952:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 4382us (4672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430838.885881:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:3.0:1787430838.893785:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.893887:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836270336 00000100:00100000:0.0:1787430838.893897:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836270336 00000100:00100000:0.0:1787430838.893958:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 246 00000100:00100000:0.0:1787430838.893970:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:12456:x1874256836270336:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787430838.894051:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.894069:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.894081:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.894133:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.894149:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 21 pid: 6496 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.894163:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847830016:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430838.894247:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35eed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430838.897640:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847830016:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430838.897672:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.904015:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.904905:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836270464 00000100:00100000:0.0:1787430838.904916:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836270464 00010000:00010000:0.0:1787430838.905050:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 22 pid: 6496 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.905096:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:0.0:1787430838.905123:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:2401:x1874256836270464:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430838.905154:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430838.905162:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 22 pid: 6496 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.905177:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 22 pid: 6496 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.905210:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ed4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ba0 expref: 22 pid: 6496 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.905254:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.905671:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 21 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.905683:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.905692:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.905700:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.905730:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430838.905969:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.905977:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.906157:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.906171:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.906179:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.906210:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.906247:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 22 pid: 6499 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.906263:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847830144:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430838.906344:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:2401:x1874256836270464:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 1237us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430838.906354:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:1.0:1787430838.909484:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430838.912690:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.912813:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a90700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847830144:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430838.912856:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.912948:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836270592 00000100:00100000:3.0:1787430838.912956:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836270592 00010000:00010000:3.0:1787430838.912991:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 22 pid: 6499 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430838.913020:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:3.0:1787430838.913029:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c115b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:2400:x1874256836270592:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430838.913043:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430838.913050:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 22 pid: 6499 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.913062:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 22 pid: 6499 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.913083:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175600/0x4dbb683ba6a94f9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bdf expref: 22 pid: 6499 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.913113:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:3.0:1787430838.913144:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.913155:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.913162:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.913204:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430838.913258:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c115b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:2400:x1874256836270592:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 229us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430838.913267:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 106 00010000:00010000:0.0:1787430838.913540:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.913548:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430838.913690:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1787430838.913805:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1787430838.913844:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1787430838.913920:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847830272:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787430838.913968:0:10098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430838.913996:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18ac59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430838.914630:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847830272 00000100:00100000:3.0:1787430838.914639:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847830272 00000100:00100000:3.0:1787430838.914681:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787430838.914689:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10098:x1874256847830272:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787430838.914782:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10098:x1874256847830272:12345-0@lo:1000:mdt00_004.0 Request processed in 94us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430838.914789:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787430838.914876:0:10098:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1787430838.914882:0:10098:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:1.0:1787430838.914898:0:10098:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b04c33800, transno 4294967322 00000004:00080000:1.0:1787430838.914917:0:10098:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b04c33b80, transno 4294967323 00000100:00100000:1.0:1787430838.914923:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847830272:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787430838.915031:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787430838.915081:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847830400:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787430838.915135:0:10098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430838.915160:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847830400 00000100:00100000:1.0:1787430838.915163:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847830400 00000100:00100000:1.0:1787430838.915183:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787430838.915189:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10098:x1874256847830400:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787430838.915282:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10098:x1874256847830400:12345-0@lo:1000:mdt00_004.0 Request processed in 81us (135us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787430838.915288:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787430838.915459:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430838.915478:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10098:1874256847830400:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787430838.915504:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915527:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915534:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915540:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.915545:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915552:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915567:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:1.0:1787430838.915569:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430838.915573:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915579:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4c00/0x4dbb683ba6a94fec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915629:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915636:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915642:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915647:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430838.915656:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915662:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915671:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.915673:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430838.915679:0:10098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915691:0:10098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915699:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.915724:0:10098:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 24 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.915735:0:10098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847830528:192.168.202.25@tcp:105: 00000100:00100000:1.0:1787430838.915788:0:10098:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aee180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430838.919981:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.920055:0:10098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874256847830528:192.168.202.25@tcp:105: 00010000:00010000:0.0:1787430838.920077:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920087:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a94f2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920137:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920150:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920161:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920188:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920194:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920200:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920206:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175a00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.920210:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920217:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920230:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.920233:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430838.920237:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920242:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42175a00/0x4dbb683ba6a94ff3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920255:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920261:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920277:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920289:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430838.920293:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920299:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920308:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:0.0:1787430838.920310:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787430838.920312:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.920317:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c42174600/0x4dbb683ba6a94fe5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430838.920447:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12456:x1874256836270336:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 26479us (26669us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787430838.920457:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 246 00000020:00080000:0.0:1787430838.920463:0:10098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787430838.920834:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836270720 00000100:00100000:2.0:1787430838.920842:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836270720 00000100:00100000:2.0:1787430838.920887:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:2.0:1787430838.920898:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12455:x1874256836270720:12345-192.168.202.25@tcp:49:lfs.0 00000100:00100000:2.0:1787430838.921017:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12455:x1874256836270720:12345-192.168.202.25@tcp:49:lfs.0 Request processed in 121us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430838.921027:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00000040:00080000:1.0:1787430838.921517:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430838.921522:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430838.922058:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787430838.922069:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430838.924992:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.925067:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836270976 00000100:00100000:0.0:1787430838.925077:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836270976 00000100:00100000:0.0:1787430838.925152:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 247 00000100:00100000:0.0:1787430838.925163:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12455:x1874256836270976:12345-192.168.202.25@tcp:58:lfs.0 00000040:00080000:0.0:1787430838.925357:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787430838.925439:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12455:x1874256836270976:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 277us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430838.925446:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 247 00000100:00100000:3.0:1787430838.926904:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.926986:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836271232 00000100:00100000:2.0:1787430838.926995:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836271232 00000100:00100000:2.0:1787430838.927049:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:2.0:1787430838.927060:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c19997c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+24:12456:x1874256836271232:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787430838.927431:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787430838.927468:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787430838.927506:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.927523:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.927725:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.927736:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.927743:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.927750:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.927830:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787430838.927926:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c19997c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:12456:x1874256836271232:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 866us (1027us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787430838.927934:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00000020:00080000:2.0:1787430838.927939:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787430838.936666:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430838.936698:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.936709:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430838.936714:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.936725:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.936744:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:0.0:1787430838.936747:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787430838.936752:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.936758:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a94ffa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430838.936775:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430838.936777:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430838.936779:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430838.977208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430838.977429:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836271360 00000100:00100000:2.0:1787430838.977440:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836271360 00000100:00100000:2.0:1787430838.977694:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00100000:2.0:1787430838.977708:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+26:12458:x1874256836271360:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430838.977736:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430838.977760:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a95001 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138bfb expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977831:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977846:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977859:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977875:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977883:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977891:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977984:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.977995:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 27 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.978004:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.978037:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 27 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430838.978052:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 27 pid: 10098 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430838.978066:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c31180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1874256847830656:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430838.979514:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b04a6c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787430838.984104:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c31180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1874256847830656:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430838.984162:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.988461:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430838.988768:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836271616 00000100:00100000:0.0:1787430838.988778:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836271616 00000100:00100000:0.0:1787430838.988869:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:0.0:1787430838.988880:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:6159:x1874256836271616:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787430838.989099:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:6159:x1874256836271616:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 220us (646us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787430838.989107:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1787430838.993294:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430838.993489:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836271744 00000100:00100000:1.0:1787430838.993499:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836271744 00010000:00010000:1.0:1787430838.993549:0:10313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 29 pid: 10098 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430838.993593:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 107 00000100:00100000:1.0:1787430838.993623:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:2400:x1874256836271744:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430838.993640:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430838.993648:0:10313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 29 pid: 10098 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.993662:0:10313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 29 pid: 10098 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.993685:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a200/0x4dbb683ba6a94f21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bbc expref: 29 pid: 10098 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.993702:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430838.993707:0:10313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.993716:0:10313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.993725:0:10313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430838.993771:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430838.993825:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:2400:x1874256836271744:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 222us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430838.993832:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 107 00010000:00010000:3.0:1787430838.994943:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.994956:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430838.995011:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787430838.995016:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430838.995034:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995049:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995075:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995083:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995090:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995096:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430838.995112:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995128:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995141:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:3.0:1787430838.995144:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430838.995148:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995154:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a95008 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995168:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995174:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995180:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995191:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02200 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430838.995194:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995200:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995208:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2b03b29c00) 00010000:00010000:3.0:1787430838.995210:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430838.995213:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995219:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02200/0x4dbb683ba6a9500f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995253:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a95001 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bfb expref: 28 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995267:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bfb expref: 27 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430838.995275:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:3.0:1787430838.995277:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430838.995279:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f02a00, rc 0) 00000100:00100000:3.0:1787430838.995341:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12458:x1874256836271360:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 17637us (18142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430838.995349:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00100000:1.0:1787430839.039988:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430839.040020:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847830784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430839.040096:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430839.041085:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847830784 00000100:00100000:2.0:1787430839.041095:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847830784 00000100:00100000:2.0:1787430839.041195:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787430839.041209:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847830784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430839.041245:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787430839.041310:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847830784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430839.041317:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787430839.041355:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430839.041367:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847830912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430839.041416:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430839.041459:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847830912 00000100:00100000:2.0:1787430839.041463:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847830912 00000100:00100000:2.0:1787430839.041485:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787430839.041492:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847830912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430839.041503:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787430839.041531:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847830912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430839.041544:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787430839.041583:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847830912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430839.041817:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430839.041829:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847831040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430839.041871:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430839.041906:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847831040 00000100:00100000:0.0:1787430839.041910:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847831040 00000100:00100000:0.0:1787430839.041954:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787430839.041973:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847831040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787430839.042001:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787430839.042037:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847831040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430839.042044:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787430839.042077:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847831040:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787430839.042200:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430839.042684:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847830784:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787430839.297081:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430839.935849:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430839.935858:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430839.935906:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787430839.935916:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787430839.936064:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a91500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847831168:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787430839.936195:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aeee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430839.939695:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a91500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1874256847831168:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430839.951236:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430839.951316:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836271872 00000100:00100000:1.0:1787430839.951328:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836271872 00000100:00100000:1.0:1787430839.951395:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 249 00000100:00100000:1.0:1787430839.951406:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12470:x1874256836271872:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787430839.951448:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787430839.951574:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12470:x1874256836271872:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 170us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430839.951582:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 249 00000100:00100000:1.0:1787430839.964279:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430839.966487:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836272128 00000100:00100000:2.0:1787430839.966503:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836272128 00000100:00100000:2.0:1787430839.966636:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00100000:2.0:1787430839.966655:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+27:12470:x1874256836272128:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430839.966678:0:8819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430839.966701:0:8819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9501d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c02 expref: -99 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430839.966813:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a95024 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430839.966828:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a95024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430839.966842:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a95024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430839.966874:0:8819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787430839.966993:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02e00/0x4dbb683ba6a9501d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c02 expref: 30 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430839.968134:0:8819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a95024 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c02 expref: 29 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430839.968148:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:2.0:1787430839.968151:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430839.968155:0:8819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03400, rc 0) 00000100:00100000:2.0:1787430839.968223:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:12470:x1874256836272128:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1575us (3952us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787430839.968232:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00100000:3.0:1787430839.976832:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430839.976875:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430839.977434:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836272512 00000100:00100000:2.0:1787430839.977446:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836272512 00000100:00100000:2.0:1787430839.977505:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1787430839.977516:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:2400:x1874256836272512:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430839.977543:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430839.977567:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03400/0x4dbb683ba6a95024 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c02 expref: 29 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430839.977582:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:2.0:1787430839.977587:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430839.978292:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:2400:x1874256836272512:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 773us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430839.978302:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:1.0:1787430839.978410:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836272384 00000100:00100000:1.0:1787430839.978422:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836272384 00000100:00100000:1.0:1787430839.978469:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:1.0:1787430839.978479:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+28:12470:x1874256836272384:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787430839.978556:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978585:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978618:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978817:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978825:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978832:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978838:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430839.978842:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978850:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978861:0:13789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430839.978864:0:13789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787430839.978868:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430839.978883:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5000/0x4dbb683ba6a95032 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430839.978973:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:12470:x1874256836272384:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 494us (2150us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787430839.978980:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 251 00000040:00080000:2.0:1787430839.979534:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430839.979540:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430839.983123:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787430839.983150:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430839.986508:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430839.987665:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836272768 00000100:00100000:1.0:1787430839.987678:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836272768 00000100:00100000:1.0:1787430839.987741:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:1.0:1787430839.987751:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+29:12470:x1874256836272768:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787430839.987969:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:12470:x1874256836272768:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 218us (1470us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787430839.987976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000040:00080000:1.0:1787430840.214147:0:14733:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430840.214155:0:14733:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430840.214185:0:14733:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787430840.214191:0:14733:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787430840.322630:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430840.324807:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430840.324848:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430840.324877:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430840.324897:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430840.324917:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430840.324949:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836273024 00000100:00100000:3.0:1787430840.324960:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836273024 00000100:00100000:3.0:1787430840.325011:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836273536 00000100:00100000:3.0:1787430840.325014:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836273536 00000100:00100000:3.0:1787430840.325032:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836273408 00000100:00100000:3.0:1787430840.325034:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836273408 00000100:00100000:3.0:1787430840.325055:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 261 00000100:00100000:3.0:1787430840.325065:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836273024:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430840.325151:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2401:x1874256836273024:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 87us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430840.325158:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 261 00000100:00100000:3.0:1787430840.325175:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 262 00000100:00100000:3.0:1787430840.325181:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836273536:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430840.325205:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836273536:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430840.325211:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 262 00000100:00100000:3.0:1787430840.325224:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 263 00000100:00100000:3.0:1787430840.325231:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836273408:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430840.325257:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2401:x1874256836273408:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430840.325275:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 263 00000100:00100000:3.0:1787430840.325296:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836273280 00000100:00100000:3.0:1787430840.325300:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836273280 00000100:00100000:3.0:1787430840.325326:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836273152 00000100:00100000:3.0:1787430840.325328:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836273152 00000100:00100000:3.0:1787430840.325347:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:3.0:1787430840.325353:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836273280:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430840.325378:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836273280:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430840.325384:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:3.0:1787430840.325394:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:3.0:1787430840.325399:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836273152:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430840.325417:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2401:x1874256836273152:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430840.325422:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00080000:3.0:1787430840.325438:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430840.325442:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430840.325445:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430840.325447:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430840.329364:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430840.329500:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836272896 00000100:00100000:3.0:1787430840.329511:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836272896 00000100:00100000:3.0:1787430840.329581:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 374 00000100:00100000:3.0:1787430840.329593:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836272896:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430840.329711:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836272896:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 120us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430840.329728:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 374 00000100:00100000:3.0:1787430840.536325:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430840.536411:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836273792 00000100:00100000:1.0:1787430840.536423:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836273792 00000100:00100000:1.0:1787430840.536504:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 252 00000100:00100000:1.0:1787430840.536515:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+30:12483:x1874256836273792:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1787430840.536554:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430840.536576:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a95039 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c09 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430840.536737:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a95040 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430840.536751:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a95040 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430840.536765:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a95040 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430840.536778:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787430840.536880:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5400/0x4dbb683ba6a95039 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c09 expref: 33 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430840.536895:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a95040 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c09 expref: 32 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430840.536903:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430840.536906:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787430840.536910:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4400, rc 0) 00000100:00100000:1.0:1787430840.536968:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:12483:x1874256836273792:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 455us (655us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787430840.536975:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 252 00000100:00080000:3.0:1787430840.537284:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430840.544044:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430840.544133:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836273920 00000100:00100000:2.0:1787430840.544145:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836273920 00000100:00100000:2.0:1787430840.544207:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00100000:2.0:1787430840.544218:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:12483:x1874256836273920:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:2.0:1787430840.544302:0:8819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544319:0:8819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544331:0:8819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544366:0:8819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544373:0:8819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544380:0:8819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544386:0:8819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430840.544391:0:8819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544397:0:8819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544427:0:8819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:2.0:1787430840.544430:0:8819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430840.544435:0:8819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430840.544441:0:8819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02600/0x4dbb683ba6a9504e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430840.544527:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+32:12483:x1874256836273920:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 310us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430840.544536:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00100000:1.0:1787430840.642207:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430840.642322:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274048 00000100:00100000:0.0:1787430840.642333:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274048 00000100:00100000:0.0:1787430840.642393:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:0.0:1787430840.642403:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2400:x1874256836274048:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:0.0:1787430840.642423:0:11754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430840.642445:0:11754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a95055 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c10 expref: -99 pid: 11754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430840.642470:0:11754:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8a07b6, atime: 0x6a8a07b5, ctime: 0x6a8a07b6, blocks: 0x8 00010000:00010000:0.0:1787430840.642490:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1787430840.642495:0:11754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430840.642505:0:11754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a95055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c10 expref: 8 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430840.642562:0:11754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a95055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c10 expref: 8 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430840.642577:0:11754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175200, rc 0) 00000100:00100000:0.0:1787430840.642696:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2400:x1874256836274048:12345-192.168.202.25@tcp:101:cat.0 Request processed in 293us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430840.642704:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:1.0:1787430840.647695:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430840.647851:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274176 00000100:00100000:2.0:1787430840.647861:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274176 00002000:00100000:2.0:1787430840.647913:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8e2b04a90a80 x1874256836274176/t0(0) o3->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:61/0 lens 488/0 e 0 to 0 dl 1787430851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430840.647924:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b04a90a80 with x1874256836274176 ext(0->4095) 00002000:00010000:2.0:1787430840.647930:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b04a90a80 00000100:00100000:2.0:1787430840.647954:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1787430840.647966:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2401:x1874256836274176:12345-192.168.202.25@tcp:3:cat.0 00000100:00100000:2.0:1787430840.648160:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+8:2401:x1874256836274176:12345-192.168.202.25@tcp:3:cat.0 Request processed in 194us (474us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787430840.648167:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00002000:00100000:2.0:1787430840.648176:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8e2b04a90a80 x1874256836274176/t0(0) o3->419b0c27-15f9-4e73-995a-bc02788ae1b0@192.168.202.25@tcp:61/0 lens 488/4536 e 0 to 0 dl 1787430851 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430840.648195:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2b04a90a80 with x1874256836274176 ext(0->4095) 00002000:00010000:2.0:1787430840.648206:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2b04a90a80 00000040:00080000:2.0:1787430841.023829:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430841.023839:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430841.023858:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787430841.023865:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787430841.344118:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430841.602814:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847831296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430841.602893:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430841.603007:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847831296 00000100:00100000:1.0:1787430841.603015:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847831296 00000100:00100000:1.0:1787430841.603065:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787430841.603076:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847831296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787430841.603125:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787430841.603172:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847831296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430841.603179:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787430841.603225:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847831296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430841.603691:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847831424:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.603732:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.603763:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847831936:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.603787:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.603805:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847832448:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.603822:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.603840:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787430841.603845:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847831552:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.603865:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.603880:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847832064:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.603900:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.603914:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847832576:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.603937:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.603967:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847831936 00000100:00100000:2.0:1787430841.603972:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847831936 00000100:00100000:2.0:1787430841.604014:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832448 00000100:00100000:2.0:1787430841.604017:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832448 00000100:00100000:2.0:1787430841.604033:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847831552 00000100:00100000:2.0:1787430841.604036:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847831552 00000100:00100000:2.0:1787430841.604046:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832064 00000100:00100000:2.0:1787430841.604049:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832064 00000100:00100000:2.0:1787430841.604073:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832576 00000100:00100000:2.0:1787430841.604076:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832576 00000100:00100000:2.0:1787430841.604113:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787430841.604120:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847831936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604159:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847831936:12345-0@lo:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.604165:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787430841.604180:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787430841.604186:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847832448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604209:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1874256847832448:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.604214:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787430841.604224:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787430841.604230:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847831552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604255:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847831552:12345-0@lo:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.604260:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787430841.604272:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787430841.604278:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847832064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604302:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847832064:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.604308:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787430841.604320:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787430841.604326:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847832576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604352:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847832576:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.604358:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1787430841.604390:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430841.604394:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430841.604407:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847831680:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604436:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.604456:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847832192:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604478:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.604496:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847832704:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604515:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.604683:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787430841.604691:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847831808:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604717:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.604733:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847832320:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604767:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.604788:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847832832:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604811:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.604839:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847831680 00000100:00100000:2.0:1787430841.604843:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847831680 00000100:00100000:2.0:1787430841.604869:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787430841.604875:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847831680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.604910:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847831680:12345-0@lo:400:kworker.0 Request processed in 35us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.604916:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787430841.604933:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832192 00000100:00100000:2.0:1787430841.604936:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832192 00000100:00100000:2.0:1787430841.604964:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832704 00000100:00100000:2.0:1787430841.604967:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832704 00000100:00100000:2.0:1787430841.604981:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832320 00000100:00100000:2.0:1787430841.604990:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832320 00000100:00100000:2.0:1787430841.605006:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832832 00000100:00100000:2.0:1787430841.605009:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832832 00000100:00100000:2.0:1787430841.605023:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787430841.605029:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847832192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605060:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847832192:12345-0@lo:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.605067:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787430841.605078:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787430841.605084:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847832704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605122:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847832704:12345-0@lo:400:kworker.0 Request processed in 39us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.605127:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787430841.605139:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787430841.605145:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847832320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605171:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847832320:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.605176:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787430841.605185:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787430841.605191:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847832832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605212:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847832832:12345-0@lo:400:kworker.0 Request processed in 21us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.605217:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787430841.605251:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430841.605254:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430841.605286:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847831552:0@lo:400:kworker.0 00010000:00080000:2.0:1787430841.605309:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c04e14000 x1874256847832064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430841.605320:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c04e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847832064:0@lo:400:kworker.0 00010000:00080000:2.0:1787430841.605331:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d07100 x1874256847832576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430841.605338:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847832576:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605349:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847831936:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605358:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847832448:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605391:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847832320:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605399:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847832832:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605408:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847831680:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605417:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847832192:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605426:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847832704:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.605449:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847831808 00000100:00100000:2.0:1787430841.605452:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847831808 00000100:00100000:2.0:1787430841.605479:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787430841.605485:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847831808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430841.605755:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847831424 00000100:00100000:3.0:1787430841.605760:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847831424 00000100:00100000:3.0:1787430841.605798:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1787430841.605806:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847831424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430841.605846:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847831424:12345-0@lo:400:kworker.0 Request processed in 42us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430841.605852:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1787430841.605909:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847831808:0@lo:400:kworker.0 00000100:00100000:3.0:1787430841.605939:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847831424:0@lo:400:kworker.0 00000100:00100000:2.0:1787430841.606795:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847831808:12345-0@lo:400:kworker.0 Request processed in 36us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.606808:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787430841.614266:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847832960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430841.614351:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.616891:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847832960 00000100:00100000:2.0:1787430841.616917:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847832960 00000100:00100000:2.0:1787430841.616979:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787430841.616990:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847832960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430841.617024:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430841.617116:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1874256847832960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.617125:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787430841.617240:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847832960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430841.617263:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430841.617271:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847833088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430841.617307:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430841.617504:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833088 00000100:00100000:2.0:1787430841.617519:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833088 00000100:00100000:2.0:1787430841.617559:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787430841.617567:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847833088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787430841.617592:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430841.617664:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847833088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430841.617671:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787430841.617791:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847833088:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1787430841.808518:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787430842.368886:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430843.392003:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787430843.654938:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787430843.654959:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787430844.159836:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847833216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430844.159841:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847833344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430844.160293:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847833472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430844.160739:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430844.160827:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833216 00000100:00100000:2.0:1787430844.160834:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833216 00000100:00100000:2.0:1787430844.160887:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787430844.160899:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847833216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430844.160931:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787430844.160982:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847833216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430844.160989:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1787430844.161025:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430844.161076:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847833216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430844.167561:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430844.167634:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833472 00000100:00100000:2.0:1787430844.167645:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833472 00000100:00100000:2.0:1787430844.167716:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787430844.167727:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847833472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430844.167754:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787430844.167802:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1874256847833472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430844.167809:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787430844.167858:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847833472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787430844.175797:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430844.181096:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430844.181398:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833344 00000100:00100000:0.0:1787430844.181409:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833344 00000100:00100000:0.0:1787430844.181464:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787430844.181475:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847833344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787430844.181524:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787430844.181586:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847833344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430844.181594:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787430844.181806:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847833344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787430844.416468:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787430844.689246:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787430844.689285:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2b02aee780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787430844.689291:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c10ffbc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b02aee900 00000020:00080000:2.0:1787430844.689295:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2c10ffbd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2b04970800 00000020:00080000:2.0:1787430844.689312:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1787430844.689360:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.689384:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.689392:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.689398:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430844.689403:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.689422:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.689446:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2b0353f600) 00010000:00010000:2.0:1787430844.689449:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430844.689455:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.689463:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02c00/0x4dbb683ba6a94fd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787430844.689525:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787430844.689590:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787430844.696477:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1787430844.696504:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:1.0:1787430845.443492:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430845.450370:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430845.450454:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430845.450503:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430845.450549:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274688 00000100:00100000:3.0:1787430845.450561:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274688 00000100:00100000:3.0:1787430845.450649:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:3.0:1787430845.450660:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836274688:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430845.450731:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836274688:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 72us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430845.450739:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00080000:3.0:1787430845.450759:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430845.456680:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430845.456710:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430845.457386:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274432 00000100:00100000:2.0:1787430845.457397:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274432 00000100:00080000:3.0:1787430845.457519:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430845.457623:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274944 00000100:00100000:2.0:1787430845.457628:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274944 00000100:00080000:3.0:1787430845.457683:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430845.457977:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430845.458010:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430845.458064:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274560 00000100:00100000:0.0:1787430845.458069:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274560 00000100:00100000:0.0:1787430845.458108:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 270 00000100:00100000:0.0:1787430845.458119:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2402:x1874256836274432:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430845.458208:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2402:x1874256836274432:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 89us (7846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430845.458227:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 270 00000100:00100000:0.0:1787430845.458247:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 271 00000100:00100000:0.0:1787430845.458253:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c11508050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836274944:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430845.458280:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c11508050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836274944:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (7776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430845.458287:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 271 00000100:00100000:0.0:1787430845.459636:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 272 00000100:00100000:0.0:1787430845.459649:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836274560:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430845.459688:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836274560:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 43us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430845.459695:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 272 00000100:00080000:0.0:1787430845.459726:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430845.460148:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274816 00000100:00100000:2.0:1787430845.460155:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274816 00000100:00080000:0.0:1787430845.460279:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430845.460310:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:2.0:1787430845.460320:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836274816:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430845.460349:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836274816:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 32us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430845.460355:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:0.0:1787430845.460991:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836274304 00000100:00100000:0.0:1787430845.460998:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836274304 00000100:00100000:0.0:1787430845.461036:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 376 00000100:00100000:0.0:1787430845.461044:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836274304:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430845.461085:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836274304:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 42us (4415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430845.461092:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 376 00000100:00100000:2.0:1787430845.466909:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836275072 00000100:00100000:2.0:1787430845.466923:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836275072 00000100:00100000:2.0:1787430845.466993:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 273 00000100:00100000:2.0:1787430845.467005:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836275072:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430845.467108:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836275072:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 105us (9096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430845.467116:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 273 00000100:00080000:1.0:1787430845.467677:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430845.718492:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430845.718589:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836275200 00000100:00100000:2.0:1787430845.718637:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836275200 00000100:00100000:2.0:1787430845.718696:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 254 00000100:00100000:2.0:1787430845.718706:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:12136:x1874256836275200:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787430845.718821:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:12136:x1874256836275200:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 116us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430845.718828:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 254 00000100:00100000:2.0:1787430845.721150:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430845.721379:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836275328 00000100:00100000:3.0:1787430845.721388:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836275328 00000100:00100000:3.0:1787430845.721452:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 255 00000100:00100000:3.0:1787430845.721463:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:12136:x1874256836275328:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787430845.721571:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:12136:x1874256836275328:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 109us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430845.721579:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 255 00000100:00100000:1.0:1787430845.723118:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430845.723318:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836275584 00000100:00100000:2.0:1787430845.723325:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836275584 00000100:00100000:2.0:1787430845.723407:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:2.0:1787430845.723416:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:12136:x1874256836275584:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787430845.723670:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:12136:x1874256836275584:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 254us (557us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787430845.723677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:1.0:1787430845.913851:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430845.913970:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836275712 00000100:00100000:2.0:1787430845.913980:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836275712 00000100:00100000:2.0:1787430845.914058:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 256 00000100:00100000:2.0:1787430845.914070:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:12939:x1874256836275712:12345-192.168.202.25@tcp:101:lsof.0 00010000:00010000:2.0:1787430845.914100:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430845.914122:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a9505c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c17 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430845.914382:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a95063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430845.914398:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a95063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430845.914413:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a95063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430845.914461:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787430845.914465:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430845.914486:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a95063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430845.914510:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03000/0x4dbb683ba6a9505c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c17 expref: 7 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430845.914528:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a95063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c17 expref: 6 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430845.914537:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:2.0:1787430845.914541:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430845.914544:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03c00, rc 0) 00000100:00100000:2.0:1787430845.914744:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:12939:x1874256836275712:12345-192.168.202.25@tcp:101:lsof.0 Request processed in 675us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430845.914752:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 256 00010000:00010000:1.0:1787430846.463894:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430846.721988:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847833984:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722071:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722160:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847834496:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722191:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722220:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847835008:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722244:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722275:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787430846.722282:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847833600:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722311:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.722318:0:8819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833984 00000100:00100000:0.0:1787430846.722326:0:8819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833984 00000100:00100000:2.0:1787430846.722333:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847834112:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722354:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722369:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847834624:0@lo:400:kworker.0 00000100:00100000:0.0:1787430846.722380:0:8819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787430846.722386:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.722389:0:8819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847833984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722400:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847835136:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722418:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.722434:0:8819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847833984:12345-0@lo:400:kworker.0 Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.722441:0:8819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787430846.722445:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847833984:0@lo:400:kworker.0 00000100:00100000:0.0:1787430846.722476:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847833728:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722477:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847834496 00000100:00100000:2.0:1787430846.722480:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847834496 00000100:00100000:0.0:1787430846.722501:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.722520:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847834240:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722521:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835008 00000100:00100000:2.0:1787430846.722524:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835008 00000100:00100000:2.0:1787430846.722537:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847834624 00000100:00100000:2.0:1787430846.722539:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847834624 00000100:00100000:0.0:1787430846.722539:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722551:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835136 00000100:00100000:2.0:1787430846.722554:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835136 00000100:00100000:2.0:1787430846.722567:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787430846.722571:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847834752:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722573:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847834496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430846.722592:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722622:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847834496:12345-0@lo:400:kworker.0 Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.722624:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847835264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430846.722628:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787430846.722645:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722649:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787430846.722655:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847835008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430846.722664:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787430846.722669:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847833856:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722682:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847835008:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.722686:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722688:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787430846.722700:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787430846.722700:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847834368:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722720:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847834624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722747:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847834624:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.722752:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787430846.722764:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787430846.722770:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847835136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722794:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847835136:12345-0@lo:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.722801:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787430846.722822:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833600 00000100:00100000:2.0:1787430846.722825:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833600 00000100:00100000:2.0:1787430846.722852:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787430846.722858:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847833600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.722885:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3627:x1874256847833600:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.722892:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787430846.722917:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847834112 00000100:00100000:2.0:1787430846.722921:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847834112 00000100:00100000:2.0:1787430846.722941:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833856 00000100:00100000:2.0:1787430846.722944:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833856 00000100:00100000:0.0:1787430846.722955:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722956:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787430846.722968:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847834112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430846.722972:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847834880:0@lo:400:kworker.0 00000100:00100000:0.0:1787430846.722992:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430846.722997:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847834112:12345-0@lo:400:kworker.0 Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.723003:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787430846.723015:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787430846.723015:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835264 00000100:00100000:0.0:1787430846.723018:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835264 00000100:00100000:2.0:1787430846.723021:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847833856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723064:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847833856:12345-0@lo:400:kworker.0 Request processed in 42us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.723070:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787430846.723099:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847833728 00000100:00100000:2.0:1787430846.723102:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847833728 00000100:00100000:2.0:1787430846.723118:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847834240 00000100:00100000:2.0:1787430846.723120:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847834240 00000100:00100000:2.0:1787430846.723132:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847834752 00000100:00100000:2.0:1787430846.723134:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847834752 00000100:00100000:2.0:1787430846.723143:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847834368 00000100:00100000:2.0:1787430846.723145:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847834368 00000100:00100000:2.0:1787430846.723155:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847834880 00000100:00100000:2.0:1787430846.723158:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847834880 00000100:00100000:2.0:1787430846.723171:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787430846.723177:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847833728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723206:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847833728:12345-0@lo:400:kworker.0 Request processed in 29us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.723212:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787430846.723224:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787430846.723230:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847834240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723256:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874256847834240:12345-0@lo:400:kworker.0 Request processed in 27us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.723271:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787430846.723284:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787430846.723291:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847834752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723322:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847834752:12345-0@lo:400:kworker.0 Request processed in 32us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.723327:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787430846.723338:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787430846.723345:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847834368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723372:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847834368:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.723378:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787430846.723389:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787430846.723395:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847834880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723420:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847834880:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430846.723426:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787430846.723455:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847833600:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723465:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847834112:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723473:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1787430846.723478:0:3627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1787430846.723509:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847834624:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723521:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787430846.723525:0:3627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787430846.723551:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2b03e57b80, transno 4294967311 00000100:00100000:2.0:1787430846.723562:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847835136:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723575:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847834496:0@lo:400:kworker.0 00000100:00100000:2.0:1787430846.723584:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847835008:0@lo:400:kworker.0 00000100:00100000:1.0:1787430846.723923:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847835392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430846.723931:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847835520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430846.723953:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430846.723953:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430846.723980:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835520 00000100:00080000:1.0:1787430846.723980:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787430846.723984:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835520 00000100:00080000:1.0:1787430846.723984:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430846.723986:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430846.723989:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430846.724008:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787430846.724014:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847835520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430846.724034:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430846.724081:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847835520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430846.724087:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787430846.724102:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835392 00000100:00100000:1.0:1787430846.724106:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835392 00000100:00100000:3.0:1787430846.724115:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847835520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430846.724162:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787430846.724172:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847835264:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430846.724227:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847833856:0@lo:400:kworker.0 00010000:00080000:3.0:1787430846.724242:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d05500 x1874256847834368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430846.724253:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847834368:0@lo:400:kworker.0 00010000:00080000:3.0:1787430846.724263:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d04e00 x1874256847834880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430846.724271:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847834880:0@lo:400:kworker.0 00000100:00100000:3.0:1787430846.724281:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847833728:0@lo:400:kworker.0 00000100:00100000:3.0:1787430846.724290:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1874256847834240:0@lo:400:kworker.0 00000100:00100000:3.0:1787430846.724300:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847834752:0@lo:400:kworker.0 00002000:00000024:0.0:1787430846.724705:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430846.724770:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847835264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 599us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.724777:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787430846.724809:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847835264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787430846.727420:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787430846.727444:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847835392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430846.729445:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787430846.729574:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847835392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2138us (5617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430846.729585:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787430846.729685:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847835392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787430847.487942:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430848.512390:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430849.265356:0:14930:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:34:08 (1787430848) 00000100:00100000:0.0:1787430849.280357:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847835648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430849.280413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430849.280569:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835648 00000100:00100000:0.0:1787430849.280576:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835648 00000100:00100000:0.0:1787430849.280634:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787430849.280641:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847835648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787430849.280667:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787430849.280705:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847835648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430849.280712:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787430849.280754:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847835648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430849.281009:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847835776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787430849.281054:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430849.281157:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835776 00000100:00100000:0.0:1787430849.281161:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835776 00000100:00100000:0.0:1787430849.281200:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787430849.281207:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847835776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787430849.281228:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787430849.281259:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847835776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430849.281266:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787430849.281282:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430849.281308:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847835776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430849.281319:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430849.281324:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847835904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430849.281350:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430849.281370:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847835904 00000100:00100000:0.0:1787430849.281372:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847835904 00000100:00100000:0.0:1787430849.281391:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787430849.281395:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847835904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430849.281402:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787430849.281421:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847835904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 26us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430849.281424:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787430849.281433:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430849.281458:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847835904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787430849.541243:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787430850.309036:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787430850.309050:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787430850.309107:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787430850.309124:0:6529:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787430850.558676:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430850.558717:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430850.558752:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430850.558775:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430850.558795:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430850.558816:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430850.558849:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430850.558879:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836276096 00000100:00100000:0.0:1787430850.558889:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836276096 00000100:00100000:0.0:1787430850.558950:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836276608 00000100:00100000:0.0:1787430850.558953:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836276608 00000100:00100000:0.0:1787430850.558973:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836275968 00000100:00100000:0.0:1787430850.558976:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836275968 00000100:00100000:0.0:1787430850.558989:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836276480 00000100:00100000:0.0:1787430850.559004:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836276480 00000100:00100000:0.0:1787430850.559037:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:0.0:1787430850.559047:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836276096:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430850.559121:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836276096:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 75us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430850.559129:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:0.0:1787430850.559159:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 281 00000100:00100000:0.0:1787430850.559175:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836276608:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430850.559200:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2402:x1874256836276608:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430850.559206:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 281 00000100:00100000:0.0:1787430850.559219:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 282 00000100:00100000:0.0:1787430850.559225:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2402:x1874256836275968:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430850.559253:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:2402:x1874256836275968:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430850.559259:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 282 00000100:00100000:0.0:1787430850.559270:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 283 00000100:00100000:0.0:1787430850.559277:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2402:x1874256836276480:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430850.559299:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2402:x1874256836276480:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430850.559305:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 283 00000100:00100000:0.0:1787430850.559324:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836276352 00000100:00100000:0.0:1787430850.559328:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836276352 00000100:00100000:0.0:1787430850.559352:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836276224 00000100:00100000:0.0:1787430850.559361:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836276224 00000100:00100000:0.0:1787430850.559389:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:0.0:1787430850.559396:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836276352:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430850.559425:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2402:x1874256836276352:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430850.559556:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:1.0:1787430850.559566:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836276224:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430850.559593:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2402:x1874256836276224:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430850.559623:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:0.0:1787430850.559909:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00080000:0.0:1787430850.559931:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430850.559935:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430850.559938:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430850.559940:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787430850.560269:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430850.560647:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836275840 00000100:00100000:3.0:1787430850.560657:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836275840 00000100:00100000:3.0:1787430850.560699:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 378 00000100:00100000:3.0:1787430850.560708:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836275840:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430850.560756:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2402:x1874256836275840:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 50us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430850.560762:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 378 00000040:00080000:0.0:1787430851.017197:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787430851.263890:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430851.263904:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430851.264549:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787430851.264557:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787430851.584801:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430851.839839:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430851.839864:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847836032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430851.839941:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430851.840038:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836032 00000100:00100000:3.0:1787430851.840049:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836032 00000100:00100000:3.0:1787430851.840100:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787430851.840110:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847836032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430851.840144:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787430851.840192:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847836032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430851.840200:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787430851.840250:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847836032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430851.840516:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847836416:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.840549:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430851.840576:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847836928:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.840648:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430851.840667:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847837440:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.840692:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430851.840711:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787430851.840717:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847836288:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.840741:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430851.840756:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847836800:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.840774:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430851.840793:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847837312:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.840812:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430851.840836:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836416 00000100:00100000:1.0:1787430851.840841:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836416 00000100:00100000:1.0:1787430851.840872:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787430851.840879:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847836416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.840919:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847836416:12345-0@lo:400:kworker.0 Request processed in 41us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430851.840926:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787430851.840946:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836928 00000100:00100000:1.0:1787430851.840950:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836928 00000100:00100000:1.0:1787430851.840979:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837440 00000100:00100000:1.0:1787430851.840982:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837440 00000100:00100000:1.0:1787430851.841017:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787430851.841025:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847836928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.841057:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847836928:12345-0@lo:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430851.841064:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787430851.841084:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787430851.841091:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3618e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847837440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.841121:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3618e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847837440:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430851.841127:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787430851.841282:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847836416:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.841295:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847836928:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.841304:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847837440:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.841454:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847836160:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.841488:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430851.841522:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847836672:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.841544:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430851.841561:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847837184:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.841580:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430851.841596:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787430851.841623:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847836544:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.841647:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430851.841661:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847837056:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.841682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430851.841697:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847837568:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.841717:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430851.841877:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836288 00000100:00100000:2.0:1787430851.841882:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836288 00000100:00100000:2.0:1787430851.841908:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836800 00000100:00100000:2.0:1787430851.841912:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836800 00000100:00100000:2.0:1787430851.841927:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837312 00000100:00100000:2.0:1787430851.841930:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837312 00000100:00100000:2.0:1787430851.841942:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836672 00000100:00100000:2.0:1787430851.841945:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836672 00000100:00100000:2.0:1787430851.841957:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837184 00000100:00100000:2.0:1787430851.841960:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837184 00000100:00100000:2.0:1787430851.841971:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836544 00000100:00100000:2.0:1787430851.841973:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836544 00000100:00100000:2.0:1787430851.841986:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787430851.842010:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847836288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430851.842060:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847836288:12345-0@lo:400:kworker.0 Request processed in 66us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430851.842067:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787430851.842083:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787430851.842097:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847836800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430851.842132:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847836800:12345-0@lo:400:kworker.0 Request processed in 35us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430851.842138:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787430851.842151:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787430851.842158:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847837312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430851.842184:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847837312:12345-0@lo:400:kworker.0 Request processed in 27us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430851.842190:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787430851.842201:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787430851.842207:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847836672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430851.842234:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847836672:12345-0@lo:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430851.842240:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787430851.842251:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787430851.842257:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847837184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430851.842284:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847837184:12345-0@lo:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430851.842290:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787430851.842302:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787430851.842308:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847836544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430851.842336:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847836544:12345-0@lo:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430851.842342:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787430851.842385:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847836288:0@lo:400:kworker.0 00010000:00080000:2.0:1787430851.842409:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04c3ad80 x1874256847836800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430851.842420:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847836800:0@lo:400:kworker.0 00010000:00080000:2.0:1787430851.842432:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04c39500 x1874256847837312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430851.842440:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847837312:0@lo:400:kworker.0 00000100:00100000:0.0:1787430851.842634:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430851.842648:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847837696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430851.842686:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787430851.842724:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430851.842730:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430851.842732:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430851.842735:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430851.842746:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837056 00000100:00100000:0.0:1787430851.842750:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837056 00000100:00100000:0.0:1787430851.842784:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837568 00000100:00100000:0.0:1787430851.842787:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837568 00000100:00100000:0.0:1787430851.842805:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787430851.842811:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847837056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430851.842846:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847837056:12345-0@lo:400:kworker.0 Request processed in 35us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430851.842852:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787430851.842864:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787430851.842870:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847837568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430851.842907:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847837568:12345-0@lo:400:kworker.0 Request processed in 38us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430851.842913:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1787430851.842947:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430851.842950:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430851.843030:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847836160 00000100:00100000:1.0:1787430851.843034:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847836160 00000100:00100000:1.0:1787430851.843071:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787430851.843079:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847836160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.843112:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c1159ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847836160:12345-0@lo:400:kworker.0 Request processed in 35us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430851.843117:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1787430851.843292:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847836544:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.843303:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847837056:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.843312:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847837568:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.843320:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847836160:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.843330:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847836672:0@lo:400:kworker.0 00000100:00100000:3.0:1787430851.843339:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847837184:0@lo:400:kworker.0 00000100:00100000:1.0:1787430851.843591:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847837824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430851.843643:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430851.850482:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837696 00000100:00100000:0.0:1787430851.850499:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837696 00000100:00100000:0.0:1787430851.850582:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837824 00000100:00100000:0.0:1787430851.850585:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837824 00000100:00100000:0.0:1787430851.850624:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787430851.850635:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847837696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787430851.850669:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430851.850766:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847837696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (8079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430851.850774:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787430851.850793:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787430851.850801:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847837824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430851.850811:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430851.850850:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847837824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (7206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430851.850855:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787430851.850910:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847837824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430851.854262:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847837696:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787430852.607890:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430853.193570:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430853.193819:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836276864 00000100:00100000:1.0:1787430853.193831:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836276864 00000100:00100000:1.0:1787430853.193953:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:1.0:1787430853.193966:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+18:13163:x1874256836276864:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:1.0:1787430853.194243:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:13163:x1874256836276864:12345-192.168.202.25@tcp:35:umount.0 Request processed in 279us (683us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787430853.194252:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00080000:0.0:1787430853.196916:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430853.203364:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430853.203691:0:14591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836277120 00000100:00100000:2.0:1787430853.203700:0:14591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836277120 00000100:00100000:2.0:1787430853.203749:0:14591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:2.0:1787430853.203756:0:14591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+19:13163:x1874256836277120:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:2.0:1787430853.204294:0:14591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:13163:x1874256836277120:12345-192.168.202.25@tcp:35:umount.0 Request processed in 533us (936us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787430853.204303:0:14591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:3.0:1787430853.208317:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430853.208536:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836277376 00000100:00100000:2.0:1787430853.208546:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836277376 00000100:00100000:2.0:1787430853.208637:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:2.0:1787430853.208647:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c19994450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+20:13163:x1874256836277376:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:2.0:1787430853.208852:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c19994450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:13163:x1874256836277376:12345-192.168.202.25@tcp:35:umount.0 Request processed in 205us (542us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787430853.208859:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:0.0:1787430853.212410:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430853.212654:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836277632 00000100:00100000:1.0:1787430853.212664:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836277632 00000100:00100000:1.0:1787430853.212723:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:1.0:1787430853.212734:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+21:13163:x1874256836277632:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:1.0:1787430853.213055:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:13163:x1874256836277632:12345-192.168.202.25@tcp:35:umount.0 Request processed in 322us (655us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787430853.213063:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:1.0:1787430853.230425:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430853.230586:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430853.236431:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430853.241291:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836277760 00000100:00100000:0.0:1787430853.241324:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836277760 00000100:00100000:0.0:1787430853.241389:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836277888 00000100:00100000:0.0:1787430853.241393:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836277888 00000100:00100000:0.0:1787430853.241424:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:0.0:1787430853.241434:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:71807ffe-f1d6-4473-b7d7-5788186ad6db+14:2401:x1874256836277760:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430853.241458:0:10313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430853.241478:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ee600/0x4dbb683ba6a94033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913876a expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430853.241496:0:10313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430853.241547:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1787430853.241559:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836277760:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 124us (11143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430853.241569:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+13:2401:x1874256836277888:12345-192.168.202.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787430853.241570:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00010000:00010000:3.0:1787430853.241583:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430853.241596:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1d200/0x4dbb683ba6a94247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138843 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430853.241632:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430853.241657:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:2401:x1874256836277888:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 101us (11071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430853.241664:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1787430853.243111:0:9495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836278016 00000100:00100000:3.0:1787430853.243122:0:9495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836278016 00000100:00100000:3.0:1787430853.243176:0:9495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:3.0:1787430853.243289:0:9495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:2399:x1874256836278016:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430853.243303:0:9495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430853.243329:0:9495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8b000/0x4dbb683ba6a93f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913872b expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430853.243346:0:9495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430853.243748:0:9495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2399:x1874256836278016:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 562us (7325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430853.243757:0:9495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:1.0:1787430853.243851:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430853.244001:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836278144 00000100:00100000:0.0:1787430853.244007:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836278144 00000100:00100000:0.0:1787430853.244061:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:0.0:1787430853.244070:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2398:x1874256836278144:12345-192.168.202.25@tcp:9:umount.0 00000020:00000080:0.0:1787430853.244098:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a94a2e 00000100:00080000:0.0:1787430853.244108:0:8409:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f91a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430853.244152:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:3.0:1787430853.244826:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787430853.244860:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430853.245458:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:419b0c27-15f9-4e73-995a-bc02788ae1b0+2:2398:x1874256836278144:12345-192.168.202.25@tcp:9:umount.0 Request processed in 1374us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430853.245469:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:0.0:1787430853.258802:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430853.258890:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836278528 00000100:00100000:1.0:1787430853.258900:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836278528 00000100:00100000:1.0:1787430853.258992:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:1.0:1787430853.259004:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2398:x1874256836278528:12345-192.168.202.25@tcp:9:umount.0 00000020:00000080:1.0:1787430853.259035:0:11754:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a945c7 00000020:00010000:1.0:1787430853.259042:0:11754:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e2c3f91d000: total 0 00000100:00080000:1.0:1787430853.259047:0:11754:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f919800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787430853.259094:0:11754:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787430853.259486:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2398:x1874256836278528:12345-192.168.202.25@tcp:9:umount.0 Request processed in 483us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430853.259495:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 83 00000020:00010000:1.0:1787430853.259514:0:6485:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e2c3f91d000: total 0 00010000:00010000:1.0:1787430853.259537:0:6485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2c3f91d000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787430853.259586:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2f294ee/0x4dbb683ba6a9497f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a2d expref: 4 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.260132:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d2ba96d/0x4dbb683ba6a95055 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c10 expref: 3 pid: 11754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.260147:0:6485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2c3f91d000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787430853.260162:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430853.260164:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430853.260166:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787430853.260747:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430853.266760:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430853.266939:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836279552 00000100:00100000:2.0:1787430853.266949:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836279552 00000100:00100000:2.0:1787430853.267016:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 257 00000100:00100000:2.0:1787430853.267038:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+22:2398:x1874256836279552:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:2.0:1787430853.267073:0:10098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f84 00000020:00010000:2.0:1787430853.267089:0:10098:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e2c3f8d3800: total 0 00000100:00080000:2.0:1787430853.267094:0:10098:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f8d0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430853.267123:0:10098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1787430853.267265:0:6484:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e2c3f8d3800: total 0 00010000:00010000:1.0:1787430853.267314:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2c3f8d3800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787430853.267346:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2b03b33e00) 00010000:00010000:1.0:1787430853.267349:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430853.267357:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1dc00/0x4dbb683ba6a942b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138851 expref: 21 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267380:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430853.267382:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430853.267386:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02a00/0x4dbb683ba6a95016 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bfb expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267398:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430853.267400:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787430853.267404:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a95040 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c09 expref: 19 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267414:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:1.0:1787430853.267416:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787430853.267426:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a94327 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913886d expref: 18 pid: 8819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267439:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430853.267441:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430853.267444:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00031800/0x4dbb683ba6a94940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a18 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267455:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430853.267457:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430853.267460:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c00030600/0x4dbb683ba6a94cf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138b29 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267469:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:1.0:1787430853.267471:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430853.267474:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f02400/0x4dbb683ba6a949e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a49 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267483:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e2c1847ba00) 00010000:00010000:1.0:1787430853.267484:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430853.267487:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef000/0x4dbb683ba6a94622 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138946 expref: 14 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267499:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b33200) 00010000:00010000:1.0:1787430853.267501:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430853.267504:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f1d400/0x4dbb683ba6a942cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138858 expref: 13 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267515:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2b0353f400) 00010000:00010000:1.0:1787430853.267521:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430853.267525:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5c00/0x4dbb683ba6a94f36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138bc3 expref: 12 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267539:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430853.267542:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787430853.267545:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a9496a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a26 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267556:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e2c132d1200) 00010000:00010000:1.0:1787430853.267558:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787430853.267561:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03200/0x4dbb683ba6a94a04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138a50 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267574:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e2c132d1400) 00010000:00010000:1.0:1787430853.267577:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430853.267580:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03a00/0x4dbb683ba6a94860 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91389e0 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430853.267592:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2c3f8d3800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787430853.267644:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430853.267646:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430853.267648:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430853.267910:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419b0c27-15f9-4e73-995a-bc02788ae1b0+7:2398:x1874256836279552:12345-192.168.202.25@tcp:39:umount.0 Request processed in 872us (1158us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787430853.267917:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 257 00000100:00100000:2.0:1787430853.275265:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430853.278072:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836279680 00000100:00100000:0.0:1787430853.278087:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836279680 00000100:00100000:2.0:1787430853.283519:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 258 00000100:00100000:2.0:1787430853.283535:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+5:2398:x1874256836279680:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:2.0:1787430853.283569:0:6499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f8b 00000100:00080000:2.0:1787430853.283587:0:6499:0:(import.c:65:import_set_state_nolock()) ffff8e2b0361f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430853.283748:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787430853.283996:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430853.284077:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419b0c27-15f9-4e73-995a-bc02788ae1b0+3:2398:x1874256836279680:12345-192.168.202.25@tcp:39:umount.0 Request processed in 545us (8819us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787430853.284086:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 258 00000100:00080000:0.0:1787430853.284344:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787430853.633417:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430854.399842:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847837952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430854.399907:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430854.400189:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847838080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430854.400218:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430854.400251:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430854.400257:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847838208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430854.400282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430854.400324:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838208 00000100:00100000:3.0:1787430854.400331:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838208 00000100:00100000:3.0:1787430854.400374:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787430854.400382:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847838208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430854.400416:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787430854.400457:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847838208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430854.400463:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787430854.400500:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847838208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430854.400717:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847837952 00000100:00100000:0.0:1787430854.400722:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847837952 00000100:00100000:0.0:1787430854.400756:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838080 00000100:00100000:0.0:1787430854.400759:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838080 00000100:00100000:0.0:1787430854.400773:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787430854.400779:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847837952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430854.400797:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787430854.400860:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787430854.400868:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847838080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430854.400878:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787430854.400906:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847838080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430854.400911:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1787430854.400950:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430854.401042:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847838080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430854.401706:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847837952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 925us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430854.401713:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787430854.404332:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847837952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787430854.656077:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430855.660350:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430855.660401:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430855.660442:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430855.660536:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836279808 00000100:00100000:3.0:1787430855.660547:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836279808 00000100:00100000:3.0:1787430855.660642:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836280064 00000100:00100000:3.0:1787430855.660645:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836280064 00000100:00100000:3.0:1787430855.660666:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836279936 00000100:00100000:3.0:1787430855.660669:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836279936 00000100:00100000:3.0:1787430855.660685:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1787430855.660696:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+12:2401:x1874256836279808:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430855.660713:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430855.660736:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360efa00/0x4dbb683ba6a94087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913877f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430855.660758:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430855.660809:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+11:2401:x1874256836279808:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 115us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430855.660817:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1787430855.660832:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1787430855.660838:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c115b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+10:2401:x1874256836280064:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430855.660845:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430855.660852:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1da00/0x4dbb683ba6a94240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b913883c expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430855.660860:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430855.660875:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c115b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+9:2401:x1874256836280064:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430855.660881:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1787430855.660932:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1787430855.660947:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+8:2401:x1874256836279936:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430855.660954:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430855.660976:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1c600/0x4dbb683ba6a9408e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b91387b0 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430855.660984:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430855.661001:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71807ffe-f1d6-4473-b7d7-5788186ad6db+7:2401:x1874256836279936:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 55us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430855.661006:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:1.0:1787430855.665422:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430855.665539:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836280320 00000100:00100000:0.0:1787430855.665551:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836280320 00000100:00100000:0.0:1787430855.665683:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 259 00000100:00100000:0.0:1787430855.665696:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+6:2398:x1874256836280320:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:0.0:1787430855.665732:0:6496:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a9409c 00000020:00010000:0.0:1787430855.665740:0:6496:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e2c3a75c000: total 0 00000100:00080000:0.0:1787430855.665745:0:6496:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a75f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430855.665773:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1787430855.665949:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2398:x1874256836280320:12345-192.168.202.25@tcp:39:umount.0 Request processed in 255us (535us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1787430855.665957:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 259 00000020:00010000:3.0:1787430855.666317:0:6484:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e2c3a75c000: total 0 00010000:00010000:3.0:1787430855.666373:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2c3a75c000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787430855.666410:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2b03b29800) 00010000:00010000:3.0:1787430855.666414:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430855.666422:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35f03c00/0x4dbb683ba6a95063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c17 expref: 4 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430855.666442:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2c3a75c000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787430855.666452:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430855.666454:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430855.666456:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430855.666543:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430855.672778:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430855.672883:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836280448 00000100:00100000:0.0:1787430855.672895:0:13789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836280448 00000100:00100000:0.0:1787430855.672990:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 260 00000100:00100000:0.0:1787430855.673003:0:13789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+5:2398:x1874256836280448:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:0.0:1787430855.673056:0:13789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a940a3 00000100:00080000:0.0:1787430855.673067:0:13789:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a75c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430855.673106:0:13789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787430855.673116:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430855.673294:0:13789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a623e317-dfe7-4c7d-8620-46d6b83d3031+3:2398:x1874256836280448:12345-192.168.202.25@tcp:39:umount.0 Request processed in 293us (526us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787430855.673303:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 260 00000100:00080000:2.0:1787430855.673556:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787430855.680005:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430855.706114:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430855.706222:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836280704 00000100:00100000:1.0:1787430855.706233:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836280704 00000100:00100000:1.0:1787430855.706299:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 380 00000100:00100000:1.0:1787430855.706311:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+7:2398:x1874256836280704:12345-192.168.202.25@tcp:251:umount.0 00000020:00000080:1.0:1787430855.706366:0:6489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f61 00000020:00010000:1.0:1787430855.706376:0:6489:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e2b03b42000: total 0 00000100:00080000:1.0:1787430855.706382:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b45800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787430855.706470:0:6485:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e2b03b42000: total 0 00000100:00100000:1.0:1787430855.706473:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71807ffe-f1d6-4473-b7d7-5788186ad6db+3:2398:x1874256836280704:12345-192.168.202.25@tcp:251:umount.0 Request processed in 163us (368us total) trans 0 rc 0/0 00010000:00010000:3.0:1787430855.706476:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430855.706484:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 380 00010000:00010000:3.0:1787430855.706551:0:6485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2b03b42000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787430855.706591:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8b200/0x4dbb683ba6a9403a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138771 expref: 2 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430855.706718:0:6485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2b03b42000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787430855.706734:0:6485:0:(genops.c:885:class_export_put()) final put ffff8e2b03b42000/71807ffe-f1d6-4473-b7d7-5788186ad6db 00010000:00010000:1.0:1787430855.706750:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430855.706752:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430855.706754:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787430855.706794:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03b42000/71807ffe-f1d6-4473-b7d7-5788186ad6db for MGS 00000020:00000080:2.0:1787430855.706846:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03b45800 for MGS 00010000:00010000:3.0:1787430856.718875:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430856.961662:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847838336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430856.961730:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430856.961784:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430856.961790:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847838464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430856.961813:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430856.961842:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838336 00000100:00100000:0.0:1787430856.961848:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838336 00000100:00100000:0.0:1787430856.961923:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787430856.961942:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847838336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787430856.961980:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430856.962022:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847838336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430856.962029:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787430856.962079:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847838336:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787430856.962465:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430856.964120:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847838592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430856.964358:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430856.967930:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838464 00000100:00100000:1.0:1787430856.968017:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838464 00000100:00100000:1.0:1787430856.968089:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787430856.968101:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847838464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787430856.968149:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787430856.968231:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847838464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (6416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430856.968239:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787430856.968304:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847838464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430856.968598:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847839104:0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.968628:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847838720:0@lo:400:kworker.0 00000100:00100000:3.0:1787430856.968654:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430856.968655:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430856.968684:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847839232:0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.968722:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430856.968765:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847839744:0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.968785:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430856.968809:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847838976:0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.968810:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847839104 00000100:00100000:2.0:1787430856.968815:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847839104 00000100:00100000:1.0:1787430856.968833:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430856.968845:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847839232 00000100:00100000:1.0:1787430856.968847:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847839488:0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.968848:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847839232 00000100:00100000:2.0:1787430856.968871:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847839744 00000100:00100000:2.0:1787430856.968874:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847839744 00000100:00100000:2.0:1787430856.968892:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787430856.968899:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847839104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.968948:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847839104:12345-0@lo:400:kworker.0 Request processed in 49us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430856.968963:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787430856.968978:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787430856.968984:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847839232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.969016:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1874256847839232:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430856.969021:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430856.969023:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787430856.969034:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787430856.969038:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787430856.969040:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847839744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.969043:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847838848:0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.969060:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430856.969063:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847839744:12345-0@lo:400:kworker.0 Request processed in 24us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430856.969069:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787430856.969069:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847839360:0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.969078:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838848 00000100:00100000:2.0:1787430856.969081:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838848 00000100:00100000:1.0:1787430856.969086:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430856.969093:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847839360 00000100:00100000:1.0:1787430856.969095:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847839872:0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.969102:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847839360 00000100:00100000:1.0:1787430856.969111:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430856.969115:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847839872 00000100:00100000:2.0:1787430856.969117:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847839872 00000100:00100000:2.0:1787430856.969140:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787430856.969146:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847838848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.969256:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787430856.969265:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847839360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.969402:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847838848:12345-0@lo:400:kworker.0 Request processed in 255us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430856.969402:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847839360:12345-0@lo:400:kworker.0 Request processed in 138us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430856.969409:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787430856.969572:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838592 00000100:00100000:0.0:1787430856.969577:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838592 00000100:00100000:0.0:1787430856.969622:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787430856.969630:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847838592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430856.969645:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787430856.969686:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847838592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (5328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430856.969691:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787430856.969818:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847839104:0@lo:400:kworker.0 00000100:00100000:3.0:1787430856.969827:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847839616:0@lo:400:kworker.0 00000100:00100000:3.0:1787430856.969853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430856.969890:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847838592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430856.969947:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847839488 00000100:00100000:0.0:1787430856.970000:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847839488 00000100:00100000:0.0:1787430856.970032:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847839616 00000100:00100000:0.0:1787430856.970035:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847839616 00000100:00100000:0.0:1787430856.970057:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787430856.970063:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847839488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430856.970092:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847839488:12345-0@lo:400:kworker.0 Request processed in 29us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430856.970098:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787430856.970108:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787430856.970113:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847839616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430856.970215:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847839616:12345-0@lo:400:kworker.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430856.970220:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787430856.970251:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847839616:0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.970476:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787430856.970493:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787430856.970501:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847839872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.970531:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847839872:12345-0@lo:400:kworker.0 Request processed in 32us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430856.970536:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787430856.970575:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1874256847839232:0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.970586:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847839744:0@lo:400:kworker.0 00000100:00100000:0.0:1787430856.970709:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838720 00000100:00100000:0.0:1787430856.970714:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838720 00000100:00100000:0.0:1787430856.970746:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787430856.970752:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847838720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430856.970789:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3628:x1874256847838720:12345-0@lo:400:kworker.0 Request processed in 37us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430856.970795:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787430856.970825:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847838720:0@lo:400:kworker.0 00000100:00080000:2.0:1787430856.972344:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430856.972352:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430856.972356:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430856.972359:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430856.972674:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847838976 00000100:00100000:2.0:1787430856.972682:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847838976 00000100:00100000:2.0:1787430856.972733:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787430856.972743:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847838976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430856.972817:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847838976:12345-0@lo:400:kworker.0 Request processed in 75us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430856.972824:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787430856.974049:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847838848:0@lo:400:kworker.0 00010000:00080000:1.0:1787430856.974068:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1b100 x1874256847839360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430856.974079:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847839360:0@lo:400:kworker.0 00010000:00080000:1.0:1787430856.974103:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b1a680 x1874256847839872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430856.974112:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847839872:0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.974173:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847838976:0@lo:400:kworker.0 00000100:00100000:1.0:1787430856.974188:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847839488:0@lo:400:kworker.0 00000020:01000004:1.0:1787430857.282189:0:15125:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787430857.301352:0:15125:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787430857.302089:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.302104:0:15125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.302113:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.302120:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.302139:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787430857.302144:0:15125:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787430857.302171:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430857.302176:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787430857.302183:0:15125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787430857.302209:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a4b9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787430857.302244:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847840000:0@lo:39:umount.0 00000100:00100000:2.0:1787430857.302317:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430857.303710:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840000 00000100:00100000:2.0:1787430857.303722:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840000 00000100:00100000:2.0:1787430857.303774:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787430857.303783:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874256847840000:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787430857.303810:0:6499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b78 00000100:00080000:2.0:1787430857.303818:0:6499:0:(import.c:65:import_set_state_nolock()) ffff8e2c315da800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787430857.303892:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3626:x1874256847840000:12345-0@lo:39:umount.0 Request processed in 109us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430857.303899:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1787430857.303920:0:6499:0:(genops.c:885:class_export_put()) final put ffff8e2c315db000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1787430857.304058:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a4b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787430857.304066:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847840000:0@lo:39:umount.0 00000100:00080000:2.0:1787430857.304088:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430857.304090:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787430857.304094:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787430857.305731:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.305749:0:15125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.305757:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.305765:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.305820:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787430857.305827:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.305833:0:15125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.305840:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.305846:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430857.306525:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787430857.306533:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430857.306542:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02000 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430857.306546:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430857.306554:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430857.306561:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430857.306566:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787430857.306569:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787430857.306572:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787430857.306676:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787430857.306685:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306692:0:15125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306700:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306707:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306715:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787430857.306719:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306725:0:15125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306731:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306736:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430857.306742:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787430857.306745:0:15125:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787430857.306779:0:15125:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787430857.306783:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787430857.306786:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430857.306791:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:2.0:1787430857.306797:0:15125:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2b03891000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787430857.306802:0:15125:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2c3a4bd000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787430857.306806:0:15125:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2c31564800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787430857.306811:0:15125:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2c3b9ee000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787430857.306817:0:15125:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8e2c3a75c000 a623e317-dfe7-4c7d-8620-46d6b83d3031 192.168.202.25@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787430857.306821:0:15125:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8e2c3f8d3800 419b0c27-15f9-4e73-995a-bc02788ae1b0 192.168.202.25@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787430857.306826:0:15125:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8e2c11533370) has exports, disconnecting them 00000020:00080000:2.0:1787430857.306830:0:15125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2b03891000), last request at 1787430856 00000020:00000080:2.0:1787430857.306836:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e88 00000100:00080000:2.0:1787430857.306852:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2b03890800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787430857.306892:0:15125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2b03891000): rc 0 00000020:00000080:2.0:1787430857.306894:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2b03891000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787430857.306899:0:15125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2c3a4bd000), last request at 1787430856 00000020:00000080:2.0:1787430857.306902:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93d69 00000100:00080000:2.0:1787430857.306907:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c077e1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787430857.306912:0:15125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2c3a4bd000): rc 0 00000020:00000080:2.0:1787430857.306913:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3a4bd000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787430857.306916:0:15125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2c31564800), last request at 1787430680 00000020:00000080:2.0:1787430857.306918:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93c5f 00000100:00080000:2.0:1787430857.306921:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c31562800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787430857.306925:0:15125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2c31564800): rc 0 00000020:00000080:2.0:1787430857.306926:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c31564800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:0.0:1787430857.307011:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787430857.307018:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307024:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efe00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430857.307027:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307034:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430857.307040:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430857.307044:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430857.307046:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787430857.307048:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787430857.307068:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307073:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430857.307095:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307102:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360efe00/0x4dbb683ba6a94017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a9401e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307113:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787430857.307116:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307130:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175c00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430857.307133:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307139:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430857.307145:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430857.307150:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430857.307152:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787430857.307153:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787430857.307166:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307171:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430857.307186:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307192:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a93f1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307203:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430857.307206:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307211:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430857.307213:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307225:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430857.307231:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430857.307237:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787430857.307239:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787430857.307241:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787430857.307253:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307259:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430857.307265:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307271:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a94278 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a9427f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307280:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430857.307283:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307288:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c013eae00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430857.307290:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307296:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430857.307312:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430857.307318:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430857.307320:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787430857.307321:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787430857.307334:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307340:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430857.307345:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307351:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c013eae00/0x4dbb683ba6a93ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93ade expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307361:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430857.307363:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430857.307364:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430857.307440:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847840128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.307499:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430857.307544:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430857.307550:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847840512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.307572:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430857.307617:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847840256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.307643:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430857.307659:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430857.307664:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847840384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.307691:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430857.307722:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840128 00000100:00100000:0.0:1787430857.307728:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840128 00000100:00100000:0.0:1787430857.307768:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840512 00000100:00100000:0.0:1787430857.307771:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840512 00000100:00100000:0.0:1787430857.307784:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840256 00000100:00100000:0.0:1787430857.307787:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840256 00000100:00100000:0.0:1787430857.307797:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840384 00000100:00100000:0.0:1787430857.307799:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840384 00000100:00100000:0.0:1787430857.307814:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787430857.307823:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+27:3630:x1874256847840128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430857.307834:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430857.307846:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1ca00/0x4dbb683ba6a9401e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a94017 expref: 27 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.307858:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430857.307886:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+26:3630:x1874256847840128:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430857.307893:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787430857.307906:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430857.307912:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+25:3630:x1874256847840512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430857.307918:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430857.307925:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c01491e00/0x4dbb683ba6a93ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93ad7 expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.308008:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430857.308031:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+24:3630:x1874256847840512:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430857.308037:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430857.308054:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430857.308060:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+23:3627:x1874256847840256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430857.308067:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430857.308074:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8a000/0x4dbb683ba6a93f22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93f1b expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.308083:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430857.308108:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+22:3627:x1874256847840256:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430857.308114:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430857.308125:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430857.308132:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+21:3627:x1874256847840384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430857.308138:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430857.308146:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1cc00/0x4dbb683ba6a9427f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a94278 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430857.308154:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430857.308174:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3627:x1874256847840384:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430857.308179:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430857.308221:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847840384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.308230:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847840256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.308253:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847840512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.308260:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3630:1874256847840128:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787430857.308332:0:15125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2c3b9ee000), last request at 1787430680 00000020:00000080:2.0:1787430857.308339:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93c27 00000100:00080000:2.0:1787430857.308344:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9ed800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430857.308363:0:15125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:1.0:1787430857.308795:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430857.308803:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430857.308817:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430857.308831:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a94009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94010 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430857.308843:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430857.308845:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430857.308847:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430857.309035:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430857.309052:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847840640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430857.309082:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787430857.309294:0:15125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2c3b9ee000): rc 0 00000004:00000080:2.0:1787430857.309303:0:15125:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9cc941903ae0 00000100:00080000:2.0:1787430857.309320:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787430857.309324:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1787430857.310075:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430857.310768:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430857.310777:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787430857.310788:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c315db000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787430857.310841:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03891000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787430857.310865:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a4bd000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787430857.310886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c31564800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787430857.310912:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c315da800 for lustre-MDT0000 00000020:00000080:3.0:1787430857.310917:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03890800 for lustre-MDT0000 00000020:00000080:3.0:1787430857.310921:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c077e1800 for lustre-MDT0000 00000020:00000080:3.0:1787430857.310924:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c31562800 for lustre-MDT0000 00000100:00080000:2.0:1787430857.312445:0:15125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787430857.312474:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c077e6000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787430857.312666:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787430857.312671:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787430857.312685:0:15125:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00100000:2.0:1787430857.312806:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00000001:00080000:2.0:1787430857.312816:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787430857.312820:0:6475:0:(genops.c:885:class_export_put()) final put ffff8e2c3a75c000/a623e317-dfe7-4c7d-8620-46d6b83d3031 00000001:00100000:2.0:1787430857.312830:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000001:00080000:2.0:1787430857.312834:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787430857.312842:0:6475:0:(genops.c:885:class_export_put()) final put ffff8e2c3f8d3800/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000100:00080000:2.0:1787430857.312856:0:15125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787430857.312866:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c363af800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787430857.312872:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787430857.312874:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787430857.312882:0:15125:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787430857.313053:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847840768:0@lo:39:umount.0 00000100:00100000:3.0:1787430857.313124:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430857.313156:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847840896:0@lo:9:umount.0 00000100:00100000:3.0:1787430857.313182:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787430857.313215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a75c000/a623e317-dfe7-4c7d-8620-46d6b83d3031 for lustre-MDT0000 00000020:00000080:3.0:1787430857.313252:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f8d3800/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-MDT0000 00000020:00000080:3.0:1787430857.313280:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3a75f800 for lustre-MDT0000 00000020:00000080:3.0:1787430857.313298:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3f8d0000 for lustre-MDT0000 00000100:00100000:3.0:1787430857.313315:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840768 00000100:00100000:3.0:1787430857.313323:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840768 00000100:00100000:3.0:1787430857.313370:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787430857.313379:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874256847840768:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787430857.313406:0:6503:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93ccf 00000100:00080000:3.0:1787430857.313414:0:6503:0:(import.c:65:import_set_state_nolock()) ffff8e2c35cb4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787430857.313432:0:6503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787430857.313565:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3626:x1874256847840768:12345-0@lo:39:umount.0 Request processed in 186us (440us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787430857.313572:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787430857.313594:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840896 00000100:00100000:3.0:1787430857.313598:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840896 00000100:00100000:3.0:1787430857.313638:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787430857.313643:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1874256847840896:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787430857.313657:0:11754:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e0a 00000100:00080000:3.0:1787430857.313662:0:11754:0:(import.c:65:import_set_state_nolock()) ffff8e2c315de000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787430857.313691:0:11754:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787430857.313760:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3626:x1874256847840896:12345-0@lo:9:umount.0 Request processed in 116us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430857.313766:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787430857.313803:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c077e6000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787430857.313808:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847840768:0@lo:39:umount.0 00000100:00080000:3.0:1787430857.313816:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c363af800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787430857.313819:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787430857.313820:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787430857.313822:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847840896:0@lo:9:umount.0 00010000:00010000:3.0:1787430857.313839:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430857.313918:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430857.314077:0:15125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787430857.314091:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f8d4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787430857.314130:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8e2c11533370) has no exports 00000100:00100000:3.0:1787430857.314416:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847841024:0@lo:9:umount.0 00000100:00100000:3.0:1787430857.314448:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430857.314516:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841024 00000100:00100000:2.0:1787430857.314526:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841024 00000100:00100000:2.0:1787430857.314561:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787430857.314568:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874256847841024:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787430857.314582:0:8830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f4c 00000100:00080000:2.0:1787430857.314588:0:8830:0:(import.c:65:import_set_state_nolock()) ffff8e2b0361c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430857.314643:0:8830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787430857.314726:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3626:x1874256847841024:12345-0@lo:9:umount.0 Request processed in 158us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430857.314733:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1787430857.314828:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430857.314846:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f8d4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787430857.314861:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787430857.314864:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787430857.314867:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847841024:0@lo:9:umount.0 00000100:00100000:1.0:1787430857.315472:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847840640 00000100:00100000:1.0:1787430857.315478:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847840640 00000100:00100000:1.0:1787430857.315525:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787430857.315533:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+20:3629:x1874256847840640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430857.315544:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430857.315562:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ef800/0x4dbb683ba6a94010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a94009 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430857.315575:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430857.315639:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3629:x1874256847840640:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (6556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430857.315647:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430857.315721:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847840640:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787430857.323139:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8e2c11533370) has no exports 00000020:00000080:2.0:1787430857.358889:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b32 00000020:00000080:2.0:1787430857.358905:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3a4ba800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787430857.359028:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787430857.359102:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430857.359113:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787430857.359118:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8e2c109619b8) has no exports 00000020:00000080:3.0:1787430857.359399:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b2b 00000020:00000080:3.0:1787430857.359404:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3a49d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787430857.359429:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a4ba800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787430857.359497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a49d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787430857.359552:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430857.359559:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787430857.359562:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3a49e800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787430857.359564:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a49e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787430857.359571:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787430857.729451:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430858.754224:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430859.519891:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430859.519922:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847841152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430859.520043:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430859.520268:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430859.520282:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847841280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787430859.520329:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430859.520382:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841280 00000100:00100000:1.0:1787430859.520394:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841280 00000100:00080000:0.0:1787430859.520450:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430859.520707:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841152 00000100:00100000:3.0:1787430859.520715:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841152 00000100:00100000:3.0:1787430859.520763:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787430859.520774:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3628:x1874256847841152:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1787430859.520783:0:6502:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787430859.520832:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3628:x1874256847841152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (788us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787430859.520841:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:02020000:3.0:1787430859.520900:0:3628:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1787430859.520917:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787430859.520946:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847841280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787430859.520980:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787430859.521072:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847841280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430859.521167:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847841280:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787430859.526711:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787430859.526723:0:3628:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787430859.526729:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787430859.532405:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000001:00100000:2.0:1787430859.534083:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787430859.534095:0:9485:0:(genops.c:885:class_export_put()) final put ffff8e2b0361e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787430859.534124:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:2.0:1787430859.534128:0:9485:0:(genops.c:885:class_export_put()) final put ffff8e2c3f919000/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:1.0:1787430859.534141:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0361e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787430859.534223:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f919000/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-OST0001 00000020:00000080:1.0:1787430859.534240:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b0361c000 for lustre-OST0001 00000020:00000080:1.0:1787430859.534244:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3f91a800 for lustre-OST0001 00000001:00100000:0.0:1787430859.534750:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787430859.534756:0:8404:0:(genops.c:885:class_export_put()) final put ffff8e2c35c13000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787430859.534776:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:0.0:1787430859.534779:0:8404:0:(genops.c:885:class_export_put()) final put ffff8e2c3f91d000/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:2.0:1787430859.539527:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c35c13000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787430859.539711:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f91d000/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-OST0000 00000020:00000080:2.0:1787430859.539745:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c315de000 for lustre-OST0000 00000001:00100000:1.0:1787430859.539750:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787430859.539754:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3f919800 for lustre-OST0000 00000001:00080000:1.0:1787430859.539774:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1787430859.539781:0:7427:0:(genops.c:885:class_export_put()) final put ffff8e2c07755800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787430859.539800:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a623e317-dfe7-4c7d-8620-46d6b83d3031 00000001:00080000:1.0:1787430859.539811:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1787430859.539813:0:7427:0:(genops.c:885:class_export_put()) final put ffff8e2c3a758000/a623e317-dfe7-4c7d-8620-46d6b83d3031 00000020:00000080:2.0:1787430859.539822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c07755800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:1.0:1787430859.539837:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 419b0c27-15f9-4e73-995a-bc02788ae1b0 00000001:00080000:1.0:1787430859.539851:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787430859.539871:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a758000/a623e317-dfe7-4c7d-8620-46d6b83d3031 for lustre-MDT0001 00000020:00000080:2.0:1787430859.539907:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c35cb4000 for lustre-MDT0001 00000020:00000080:2.0:1787430859.539911:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3a75c800 for lustre-MDT0001 00000020:00000080:1.0:1787430859.540237:0:7427:0:(genops.c:885:class_export_put()) final put ffff8e2b0361c800/419b0c27-15f9-4e73-995a-bc02788ae1b0 00000020:00000080:1.0:1787430859.540272:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0361c800/419b0c27-15f9-4e73-995a-bc02788ae1b0 for lustre-MDT0001 00000020:00000080:1.0:1787430859.540318:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b0361f000 for lustre-MDT0001 00000100:00080000:3.0:1787430859.548661:0:3628:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430859.548677:0:3628:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 141 00000100:00080000:3.0:1787430859.548689:0:3628:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2c3b9e9000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430859.548772:0:3628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b1a300 x1874256847841408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430859.549085:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847841408:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787430859.549193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430859.549799:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841408 00000100:00100000:3.0:1787430859.549812:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841408 00000100:00100000:3.0:1787430859.549859:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787430859.549869:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1874256847841408:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787430859.549892:0:8069:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787430859.556793:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1874256847841408:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 6910us (7585us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430859.556812:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1787430859.557065:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787430859.557517:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787430859.557524:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847841408:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1787430859.776278:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430860.800766:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430861.248454:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787430861.825021:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430862.079844:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430862.080060:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847841536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430862.080169:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787430862.080375:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430862.080380:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787430862.080385:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430862.080392:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 321 00000100:00080000:1.0:1787430862.080399:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787430862.080412:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2c3b9e9000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430862.080440:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430862.080447:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b0483d880 x1874256847841792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430862.080474:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847841664:0@lo:400:kworker.0 00000100:00100000:0.0:1787430862.080562:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847842304:0@lo:400:kworker.0 00000100:00100000:2.0:1787430862.080578:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430862.080596:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847841792:0@lo:38:kworker.0 00000100:00100000:0.0:1787430862.080663:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430862.080679:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430862.080698:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847842176:0@lo:400:kworker.0 00000100:00100000:0.0:1787430862.080753:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842304 00000100:00100000:2.0:1787430862.080754:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430862.080765:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842304 00000100:00100000:1.0:1787430862.080779:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841664 00000100:00100000:1.0:1787430862.080786:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841664 00000100:00100000:2.0:1787430862.080830:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842176 00000100:00100000:2.0:1787430862.080842:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842176 00000100:00100000:1.0:1787430862.080868:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787430862.080879:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787430862.080886:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3629:x1874256847841664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430862.080894:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847842304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430862.080927:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787430862.080948:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847842176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430862.080995:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847842304:12345-0@lo:400:kworker.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430862.080998:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c4207c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3629:x1874256847841664:12345-0@lo:400:kworker.0 Request processed in 117us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430862.081013:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787430862.081014:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1787430862.081049:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787430862.081056:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430862.081071:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847841920:0@lo:400:kworker.0 00000100:00100000:2.0:1787430862.081088:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847842176:12345-0@lo:400:kworker.0 Request processed in 148us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430862.081099:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847842304:0@lo:400:kworker.0 00000100:00100000:2.0:1787430862.081101:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787430862.081117:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430862.081151:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847842432:0@lo:400:kworker.0 00000100:00100000:0.0:1787430862.081157:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841920 00000100:00100000:0.0:1787430862.081162:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841920 00000100:00100000:1.0:1787430862.081179:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430862.081193:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842432 00000100:00100000:0.0:1787430862.081198:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842432 00000100:00100000:1.0:1787430862.081204:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787430862.081213:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847842048:0@lo:400:kworker.0 00000100:00100000:0.0:1787430862.081222:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787430862.081230:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3627:x1874256847841920:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787430862.081239:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787430862.081240:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430862.081256:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842048 00000100:00100000:2.0:1787430862.081264:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842048 00000100:00100000:1.0:1787430862.081265:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847842560:0@lo:400:kworker.0 00000100:00100000:2.0:1787430862.081293:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787430862.081297:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3627:x1874256847841920:12345-0@lo:400:kworker.0 Request processed in 64us (183us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787430862.081313:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3627:x1874256847842432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430862.081316:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430862.081324:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00080000:2.0:1787430862.081334:0:10098:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787430862.081345:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842560 00000100:00100000:0.0:1787430862.081352:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842560 00000100:00080000:1.0:1787430862.081360:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787430862.081368:0:3627:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787430862.081376:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787430862.081400:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3627:x1874256847842432:12345-0@lo:400:kworker.0 Request processed in 91us (216us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787430862.081401:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787430862.081425:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847842560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430862.081427:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787430862.081459:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787430862.081467:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3627:x1874256847842048:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787430862.081476:0:10098:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787430862.081487:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847842560:12345-0@lo:400:kworker.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430862.081496:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1787430862.081527:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430862.081530:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3627:x1874256847842048:12345-0@lo:400:kworker.0 Request processed in 57us (287us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787430862.081555:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787430862.081651:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841792 00000100:00100000:0.0:1787430862.081658:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841792 00000100:00100000:0.0:1787430862.081691:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787430862.081698:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1874256847841792:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787430862.081717:0:6503:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:00080000:2.0:1787430862.081724:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04a93800 x1874256847842176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430862.081743:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847842176:0@lo:400:kworker.0 00000100:00100000:2.0:1787430862.081756:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847841664:0@lo:400:kworker.0 00000100:00100000:3.0:1787430862.083452:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847841536 00000100:00100000:3.0:1787430862.083470:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847841536 00000100:00080000:2.0:1787430862.084009:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430862.084563:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787430862.084587:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847841536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430862.084650:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787430862.084780:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847841536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 204us (4609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430862.084788:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787430862.084897:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847841536:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787430862.100598:0:3627:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430862.100643:0:3627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 141 00000100:00080000:1.0:1787430862.100656:0:3627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2c35c10800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430862.100754:0:3627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04a93800 x1874256847842688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430862.100799:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847841920:0@lo:400:kworker.0 00000100:00080000:1.0:1787430862.100881:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787430862.100885:0:3627:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787430862.100890:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787430862.100894:0:3627:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430862.100897:0:3627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 164 00000100:00080000:1.0:1787430862.100911:0:3627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2b03894000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430862.100929:0:3627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac1500 x1874256847842816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430862.100945:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1874256847842432:0@lo:400:kworker.0 00000100:00100000:3.0:1787430862.100994:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847842688:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1787430862.105351:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787430862.105361:0:3627:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787430862.105368:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787430862.105375:0:3627:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430862.105380:0:3627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 152 00000100:00080000:1.0:1787430862.105391:0:3627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e2b0287c800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430862.105435:0:3627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac0000 x1874256847842944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430862.105461:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847842048:0@lo:400:kworker.0 00000100:00100000:3.0:1787430862.106808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430862.107042:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847842816:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787430862.107089:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430862.107176:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847842944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787430862.107206:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430862.107294:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842688 00000100:00100000:2.0:1787430862.107305:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842688 00000100:00100000:2.0:1787430862.107357:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842816 00000100:00100000:2.0:1787430862.107361:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842816 00000100:00100000:2.0:1787430862.107384:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787430862.107394:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847842688:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787430862.107420:0:6496:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787430862.107471:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847842688:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 77us (673us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430862.107479:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787430862.107500:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787430862.107504:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847842816:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787430862.107512:0:6496:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787430862.107536:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847842816:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (446us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430862.107558:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787430862.107687:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1874256847841792:12345-0@lo:38:kworker.0 Request processed in 25987us (27011us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787430862.107698:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:1.0:1787430862.108300:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04a90380 x1874256847842560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430862.108319:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847842560:0@lo:400:kworker.0 00000100:00100000:0.0:1787430862.111262:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847842944 00000100:00100000:0.0:1787430862.111280:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847842944 00000100:00080000:3.0:1787430862.111294:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430862.111306:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787430862.111311:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847842688:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787430862.111323:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430862.111327:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787430862.111331:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847842816:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787430862.111347:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430862.111351:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787430862.111353:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787430862.111354:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847841792:0@lo:38:kworker.0 00000100:00100000:0.0:1787430862.111363:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847842944:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787430862.111388:0:6499:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787430862.111489:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847842944:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 125us (4280us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787430862.111498:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1787430862.111704:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430862.111710:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787430862.111714:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847842944:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1787430862.849647:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787430863.620641:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787430863.620656:0:6475:0:(genops.c:885:class_export_put()) final put ffff8e2c3b9ee000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787430863.620747:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3b9ee000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787430863.620826:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3b9ed800 for lustre-MDT0000 00010000:00010000:0.0:1787430863.876010:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430864.640290:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430864.640320:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847843072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430864.640418:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430864.640525:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843072 00000100:00100000:3.0:1787430864.640534:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843072 00000100:00100000:3.0:1787430864.640623:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787430864.640636:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847843072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787430864.640691:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787430864.640747:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847843072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430864.640754:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787430864.640814:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847843072:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787430864.641114:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787430864.899466:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430865.919996:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430866.944013:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430867.199835:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787430867.199930:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847843200:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787430867.199938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430867.199942:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787430867.199984:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847843328:0@lo:400:kworker.0 00000100:00100000:1.0:1787430867.200035:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430867.200035:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430867.200093:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843328 00000100:00100000:3.0:1787430867.200105:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843328 00000100:00100000:3.0:1787430867.200172:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787430867.200184:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3627:x1874256847843328:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787430867.203446:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 323 00000100:00080000:2.0:1787430867.203457:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787430867.203467:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2c3b9e9000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430867.203519:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04d1bb80 x1874256847843456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430867.203557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430867.203575:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430867.203578:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430867.203583:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 323 00000100:00080000:2.0:1787430867.203585:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787430867.203589:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2c35c10800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430867.203595:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843200 00000100:00100000:2.0:1787430867.203614:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04d1b800 x1874256847843584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430867.203620:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843200 00000100:00080000:2.0:1787430867.203623:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430867.203626:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430867.203627:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430867.203630:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 323 00000100:00080000:2.0:1787430867.203633:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787430867.203636:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e2b0287c800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430867.203647:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04d19880 x1874256847843712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430867.203688:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1787430867.203697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787430867.203700:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847843200:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787430867.203718:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430867.203720:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430867.203723:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 323 00000100:00080000:2.0:1787430867.203725:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787430867.203729:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2b03894000 using connection 192.168.202.125@tcp/0@lo 00002000:00000024:0.0:1787430867.203737:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430867.203740:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04d18e00 x1874256847844096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430867.203777:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847843456:0@lo:38:kworker.0 00000100:00100000:0.0:1787430867.203813:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847843200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430867.203821:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430867.203828:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787430867.203847:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847843584:0@lo:38:kworker.0 00000100:00080000:0.0:1787430867.203851:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430867.203879:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847844224:0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.203894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430867.203924:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847843712:0@lo:38:kworker.0 00000100:00100000:0.0:1787430867.203924:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843456 00000100:00100000:0.0:1787430867.203928:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843456 00000100:00100000:2.0:1787430867.203949:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430867.203949:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787430867.203956:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847843456:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787430867.203966:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847844096:0@lo:38:kworker.0 00010000:02000000:0.0:1787430867.203974:0:6502:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787430867.203985:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430867.204013:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843584 00000100:00100000:2.0:1787430867.204017:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843584 00000100:00100000:2.0:1787430867.204041:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843712 00000100:00100000:2.0:1787430867.204043:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843712 00000100:00100000:2.0:1787430867.204058:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847844096 00000100:00100000:2.0:1787430867.204061:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847844096 00000100:00100000:2.0:1787430867.204077:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787430867.204082:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847843584:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787430867.204089:0:6496:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787430867.204121:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847843584:12345-0@lo:38:kworker.0 Request processed in 38us (226us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430867.204137:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787430867.204153:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787430867.204158:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847843712:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787430867.204165:0:6496:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787430867.204190:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847843712:12345-0@lo:38:kworker.0 Request processed in 31us (240us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430867.204196:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787430867.204208:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787430867.204212:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847844096:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787430867.204219:0:6496:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787430867.204242:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847844096:12345-0@lo:38:kworker.0 Request processed in 28us (255us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430867.204248:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1787430867.204314:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430867.204319:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787430867.204323:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847843584:0@lo:38:kworker.0 00000100:00080000:2.0:1787430867.204333:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430867.204336:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787430867.204339:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847843712:0@lo:38:kworker.0 00000100:00080000:2.0:1787430867.204346:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430867.204349:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787430867.204351:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847844096:0@lo:38:kworker.0 00000100:00100000:2.0:1787430867.204389:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847843968:0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.204419:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430867.204463:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843968 00000100:00100000:2.0:1787430867.204467:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843968 00000100:00100000:2.0:1787430867.204504:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787430867.204512:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847843968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.204552:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847843968:12345-0@lo:400:kworker.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430867.204559:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1787430867.204576:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430867.204594:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847843968:0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.204652:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847843840:0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.204679:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430867.204707:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847843840 00000100:00100000:2.0:1787430867.204710:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847843840 00000100:00100000:2.0:1787430867.204737:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787430867.204743:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847843840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.204780:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847843840:12345-0@lo:400:kworker.0 Request processed in 38us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430867.204786:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:2.0:1787430867.204801:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787430867.204815:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d19180 x1874256847843840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430867.204825:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847843840:0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.204841:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430867.204901:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847843200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430867.204923:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847844224 00000100:00100000:2.0:1787430867.204927:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847844224 00000100:00100000:2.0:1787430867.204964:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787430867.204970:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847844224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430867.205007:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874256847844224:12345-0@lo:400:kworker.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430867.205013:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1787430867.205029:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787430867.205046:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d1a300 x1874256847844224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430867.205056:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1874256847844224:0@lo:400:kworker.0 00000100:00100000:3.0:1787430867.205987:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c12a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3f3caeb-2c11-4e8c-831c-fee5cea3edde+19:3627:x1874256847843328:12345-0@lo:400:kworker.0 Request processed in 5800us (5948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430867.205999:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787430867.206113:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847843328:0@lo:400:kworker.0 00000100:00080000:1.0:1787430867.212704:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787430867.212720:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787430867.212725:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847843456:0@lo:38:kworker.0 00000100:00100000:0.0:1787430867.218661:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847843456:12345-0@lo:38:kworker.0 Request processed in 8642us (8776us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787430867.218685:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00010000:0.0:1787430867.968211:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430868.993882:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430869.760040:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847844352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430869.760143:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430869.760516:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847844352 00000100:00100000:0.0:1787430869.760527:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847844352 00000100:00100000:0.0:1787430869.760646:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787430869.760658:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847844352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787430869.760708:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1787430869.760803:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430869.761326:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847844352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 668us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430869.761337:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787430869.761455:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847844352:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787430870.015898:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430871.039995:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430871.488437:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:02000400:1.0:1787430871.807758:0:15125:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:1.0:1787430871.814388:0:15125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2b0231ac60 - data ffff8e2c40359360/ffff8e2c3f86a800 00000020:01000000:1.0:1787430871.814525:0:15125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2c0503d3c0 - data ffff8e2c400570d8/ffff8e2c2fa7e000 00000001:00000004:1.0:1787430871.823067:0:15125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1787430871.897659:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787430871.897673:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787430871.897701:0:15125:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e2b04d19f80 x1874256847840768/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787430867 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430871.897745:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787430871.918525:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787430871.918537:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787430871.918565:0:15125:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787430871.918570:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787430871.922042:0:8825:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787430871.922077:0:8825:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787430871.922099:0:8825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787430871.922804:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787430871.922812:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787430871.922845:0:15125:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787430871.922848:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787430871.924158:0:9548:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787430871.924166:0:9548:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787430871.924182:0:9548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787430871.933862:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93afa 00000020:00000080:3.0:1787430871.933880:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c07757800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787430871.934683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c07757800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787430871.939281:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b0f 00000020:00000080:3.0:1787430871.939316:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c315d9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787430871.939335:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787430871.939342:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430871.939353:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787430871.939368:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8e2c11534d28) has no exports 00000020:00000080:2.0:1787430871.939638:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c315d9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787430871.940196:0:15125:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787430871.940210:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f45 00000020:00000080:3.0:1787430871.940219:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3f8d3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787430871.940266:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787430871.940273:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430871.940288:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787430871.940292:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8e2b03b98000) has no exports 00000020:00000080:3.0:1787430871.940351:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f3e 00000020:00000080:3.0:1787430871.940356:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3f8d4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787430871.940372:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f8d3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1787430871.941096:0:15125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787430871.941104:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787430871.941110:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1787430871.941118:0:15125:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787430871.941122:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787430871.944663:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430871.944701:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787430871.944713:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e03 00000020:00000080:3.0:1787430871.944743:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3f8d7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787430871.944754:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787430871.944760:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430871.944768:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787430871.944773:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8e2c35decd28) has no exports 00000020:00000080:3.0:1787430871.944783:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93dfc 00000020:00000080:3.0:1787430871.944788:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c363ab800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787430871.945643:0:15125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787430871.945651:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787430871.945656:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787430871.945665:0:15125:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787430871.945668:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787430871.946766:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430871.946788:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787430871.946962:0:15125:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787430871.946975:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93cc8 00000020:00000080:3.0:1787430871.946987:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3a4ba000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787430871.946999:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787430871.947005:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430871.947012:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787430871.947017:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8e2c35de99b8) has no exports 00000020:00000080:3.0:1787430871.947027:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93cc1 00000020:00000080:3.0:1787430871.947031:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c077e5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787430871.948135:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f8d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787430871.948158:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3f8d4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787430871.948170:0:8:0:(genops.c:885:class_export_put()) final put ffff8e2c3f8d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787430871.948173:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f8d6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787430871.948178:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430871.948293:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f8d7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787430871.948299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c363ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787430871.948304:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c363af800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787430871.948311:0:8:0:(genops.c:885:class_export_put()) final put ffff8e2b02879000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787430871.948313:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b02879000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787430871.948317:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430871.948340:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a4ba000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787430871.948346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c077e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787430871.949093:0:15125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787430871.949100:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787430871.949105:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787430871.949115:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787430871.949141:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c077e6000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787430871.949208:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430871.949222:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430871.949226:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c114b0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787430871.949229:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c114b0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787430871.949234:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430871.949330:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430871.949335:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430871.949338:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c07753000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787430871.949341:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c07753000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787430871.949345:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430871.949646:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b16 00000020:00000080:2.0:1787430871.949656:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c315dd000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787430871.949667:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787430871.949676:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c315dd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787430871.949687:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430871.949692:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787430871.949696:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8e2c115319b8) has no exports 00000020:00000080:2.0:1787430871.949793:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430871.949798:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787430871.949802:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c07754000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787430871.949875:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c07754000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787430871.949882:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787430871.949922:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b1d 00000020:00000080:2.0:1787430871.949929:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c315d9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787430871.949944:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c315d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1787430871.949974:0:15125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c04f2d000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787430871.949978:0:15125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c04f2d000 3 00000020:01000004:2.0:1787430871.949982:0:15125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e2c04f2d000 from lustre-MDT0000 00000020:00000080:2.0:1787430871.950008:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430871.950013:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787430871.950016:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c07753800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787430871.950018:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c07753800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787430871.950026:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787430871.950056:0:15125:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787430871.950062:0:15125:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787430871.950066:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787430871.950069:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430871.950072:0:15125:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787430871.950080:0:15125:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8e2c109e3000 d3f3caeb-2c11-4e8c-831c-fee5cea3edde 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787430871.950085:0:15125:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8e2c10960000) has exports, disconnecting them 00000020:00080000:2.0:1787430871.950089:0:15125:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e2c109e3000), last request at 1787430667 00000020:00000080:2.0:1787430871.950107:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93abb 00000020:00010000:2.0:1787430871.950112:0:15125:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8e2c109e3000: total 0 00000100:00080000:2.0:1787430871.950116:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787430871.950142:0:15125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2c109e3000): rc 0 00000020:00080000:2.0:1787430871.950146:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8e2c10960000) has no exports 00000100:00100000:2.0:1787430871.950235:0:6489:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e2c407d6600:6489] 0 exiting: rc = 1 00000020:00010000:0.0:1787430871.951408:0:6484:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8e2c109e3000: total 0 00010000:00010000:0.0:1787430871.951498:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2c109e3000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787430871.951548:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c01490000/0x4dbb683ba6a93bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93bbe expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951599:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a9402c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a94025 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951633:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1c200/0x4dbb683ba6a93fbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93fb5 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951650:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a93fca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93fc3 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951662:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8a800/0x4dbb683ba6a93edc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93ed5 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951677:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1ce00/0x4dbb683ba6a94255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a9424e expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951687:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a93fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93fdf expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951699:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c360eee00/0x4dbb683ba6a94263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a9425c expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951710:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a93fd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93fd1 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951753:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f02800/0x4dbb683ba6a94002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93ffb expref: 5 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951764:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c01491c00/0x4dbb683ba6a93bb7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93bb0 expref: 4 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951778:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f1d000/0x4dbb683ba6a93ff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a93fed expref: 3 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951789:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c01491800/0x4dbb683ba6a94271 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4dbb683ba6a9426a expref: 2 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430871.951800:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2c109e3000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787430871.952300:0:6484:0:(genops.c:885:class_export_put()) final put ffff8e2c109e3000/d3f3caeb-2c11-4e8c-831c-fee5cea3edde 00010000:00010000:0.0:1787430871.952323:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430871.952325:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430871.952328:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430871.952398:0:6492:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e2c22780e00:6492] 2 exiting: rc = 0 00000100:00100000:0.0:1787430871.952552:0:6491:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e2c10c3fe00:6491] 1 exiting: rc = 0 00000020:00000080:0.0:1787430871.952643:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c109e3000/d3f3caeb-2c11-4e8c-831c-fee5cea3edde for MGS 00000020:00000080:0.0:1787430871.952683:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c109e0000 for MGS 00000100:00100000:2.0:1787430871.952999:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953011:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953092:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953101:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953107:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953119:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953127:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953134:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953141:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953147:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953172:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953178:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953185:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953191:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953199:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953206:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953213:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953220:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953226:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953232:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953238:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953245:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953252:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953259:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953271:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953278:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953285:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953292:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953299:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953307:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953313:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953320:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953327:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953334:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953341:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953347:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953353:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953367:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953374:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953380:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953502:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953509:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953515:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953522:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953529:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953543:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953549:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953555:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953562:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953567:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953574:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953579:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953586:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953592:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953598:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953638:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953644:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953649:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953660:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953666:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953672:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953678:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953684:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430871.953690:0:15125:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787430871.964371:0:15125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2b039a4420 - data ffff8e2c402925e8/ffff8e2b03b3b000 00000020:01000000:2.0:1787430871.964553:0:15125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2c06443900 - data ffff8e2c4012d360/ffff8e2c1150c000 00000020:00000080:0.0:1787430871.966151:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93a9f 00000020:00000080:0.0:1787430871.966174:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c1153c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787430871.966203:0:15125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c04f2d000 from MGS, refs=2 00000020:01000004:0.0:1787430871.966209:0:15125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c04f2d000 2 00000020:01000004:0.0:1787430871.966212:0:15125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e2c04f2d000 from MGS 00000020:00000080:0.0:1787430871.966244:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430871.966253:0:15125:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787430871.966256:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c11538800/MGS 00000020:00000080:0.0:1787430871.966259:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c11538800/MGS for MGS 00000020:00000080:3.0:1787430871.966314:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c1153c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787430871.966346:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787430871.966570:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787430871.966575:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430871.966583:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787430871.966591:0:15125:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e2c3a4b8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787430871.966671:0:15125:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8e2c3a5b4d28) has exports, disconnecting them 00000020:00080000:0.0:1787430871.966678:0:15125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e2c3a4b8800), last request at 1787430667 00000020:00000080:0.0:1787430871.966684:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b6a 00000020:00080000:0.0:1787430871.966698:0:15125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2c3a4b8800): rc 0 00000020:00000080:0.0:1787430871.966704:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3a4b8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787430871.968143:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a4b8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787430872.015143:0:15125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787430872.015155:0:15125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430872.015161:0:15125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787430872.015170:0:15125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787430872.015380:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3a4b9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787430872.015568:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430872.015580:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787430872.015587:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c3a4bc000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787430872.015591:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a4bc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787430872.015670:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787430872.015786:0:15125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c04f2d000 1 00000020:00000080:3.0:1787430872.015794:0:15125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93a91 00000020:00000080:3.0:1787430872.015804:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c1153b800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787430872.015857:0:15125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787430872.015862:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430872.015868:0:15125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787430872.015873:0:15125:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8e2c11530000) has no exports 00000020:00000080:2.0:1787430872.022105:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c1153b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787430872.064762:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787430872.075751:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430872.075769:0:15125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787430872.075777:0:15125:0:(genops.c:885:class_export_put()) final put ffff8e2c04f29800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787430872.075783:0:15125:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c04f29800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787430872.075806:0:15125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787430872.075980:0:15125:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e2c04f2b000 00000020:02000400:2.0:1787430872.076084:0:15125:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1787430872.322337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430872.322356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430872.322360:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430872.322368:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 328 00000100:00080000:2.0:1787430872.322375:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787430872.322383:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2c3b9e9000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430872.322393:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430872.322411:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847844480:0@lo:400:kworker.0 00000400:00000100:2.0:1787430872.322465:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874256847844480 offset 0 length 224: 4 00000100:00100000:2.0:1787430872.323204:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04d19880 x1874256847844608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430872.323226:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430872.323230:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430872.323233:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430872.323236:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 328 00000100:00080000:2.0:1787430872.323240:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787430872.323244:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2c35c10800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430872.323253:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847844608:0@lo:38:kworker.0 00000100:00100000:2.0:1787430872.323293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430872.323330:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847844608 00000100:00100000:2.0:1787430872.323337:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847844608 00000100:00100000:2.0:1787430872.323368:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787430872.323378:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1874256847844608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787430872.323396:0:8069:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787430872.323439:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1874256847844608:12345-0@lo:38:kworker.0 Request processed in 60us (144us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430872.323452:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1787430872.323492:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787430872.323640:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847844736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430872.323673:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430872.323738:0:11116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847844736 00000100:00100000:0.0:1787430872.323743:0:11116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847844736 00000100:00100000:0.0:1787430872.323789:0:11116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1787430872.324105:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787430872.324111:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847844608:0@lo:38:kworker.0 00000100:00100000:2.0:1787430872.324144:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04d19880 x1874256847844864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430872.324158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430872.324162:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430872.324164:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430872.324167:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 328 00000100:00080000:2.0:1787430872.324170:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787430872.324175:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e2b0287c800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430872.324183:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847844864:0@lo:38:kworker.0 00000100:00100000:2.0:1787430872.324212:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430872.324239:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847844864 00000100:00100000:2.0:1787430872.324243:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847844864 00000100:00100000:2.0:1787430872.324265:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787430872.324270:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847844864:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787430872.324282:0:6499:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787430872.324313:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847844864:12345-0@lo:38:kworker.0 Request processed in 42us (100us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430872.324320:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787430872.324337:0:11116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847844736:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787430872.324348:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430872.324351:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787430872.324361:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847844864:0@lo:38:kworker.0 00002000:00000024:0.0:1787430872.324363:0:11116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787430872.324382:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04d19880 x1874256847844992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430872.324399:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847844992:0@lo:38:kworker.0 00000100:00100000:0.0:1787430872.324401:0:11116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847844736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430872.324408:0:11116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787430872.324420:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787430872.324425:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430872.324443:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847844992 00000100:00100000:2.0:1787430872.324446:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847844992 00000100:00100000:0.0:1787430872.324453:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847844736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787430872.324463:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787430872.324467:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847844992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787430872.324476:0:6496:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787430872.324583:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847844992:12345-0@lo:38:kworker.0 Request processed in 112us (160us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430872.324589:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1787430872.324634:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430872.324638:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787430872.324641:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847844992:0@lo:38:kworker.0 00000100:00100000:0.0:1787430872.324689:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1787430872.324695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787430872.324697:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847845120:0@lo:400:kworker.0 00000100:00080000:2.0:1787430872.324698:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430872.324700:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430872.324703:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 328 00000100:00080000:2.0:1787430872.324706:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787430872.324710:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2b03894000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430872.324720:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847845248:0@lo:400:kworker.0 00000100:00100000:0.0:1787430872.324721:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430872.324745:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430872.324748:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847845120 00000100:00100000:0.0:1787430872.324752:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847845120 00000100:00100000:2.0:1787430872.324779:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847845248 00000100:00100000:2.0:1787430872.324782:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847845248 00000100:00100000:0.0:1787430872.324783:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787430872.324789:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847845120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430872.324806:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787430872.324823:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847845248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430872.324858:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847845248:12345-0@lo:400:kworker.0 Request processed in 46us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430872.324864:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787430872.324889:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847845248:0@lo:400:kworker.0 00000100:00100000:2.0:1787430872.324913:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03d8a300 x1874256847845376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430872.324931:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847845376:0@lo:38:kworker.0 00000100:00100000:2.0:1787430872.324953:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430872.324976:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847845376 00000100:00100000:2.0:1787430872.324979:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847845376 00000100:00100000:2.0:1787430872.324994:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787430872.324999:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847845376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787430872.325009:0:6499:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787430872.325728:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847845376:12345-0@lo:38:kworker.0 Request processed in 725us (771us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430872.325736:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:2.0:1787430872.325763:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430872.325766:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787430872.325769:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847845376:0@lo:38:kworker.0 00000100:00100000:1.0:1787430872.325834:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847845504:0@lo:400:kworker.0 00000100:00100000:1.0:1787430872.325867:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430872.326376:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847845120:12345-0@lo:400:kworker.0 Request processed in 1587us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430872.326384:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787430872.326399:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847845504 00000100:00100000:0.0:1787430872.326403:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847845504 00000100:00100000:0.0:1787430872.326432:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787430872.326439:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847845504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430872.331647:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847845504:12345-0@lo:400:kworker.0 Request processed in 5160us (5731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430872.331663:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:0.0:1787430872.331712:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430872.331717:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787430872.331837:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e2b04d19880 x1874256847845120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430872.331857:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847845120:0@lo:400:kworker.0 00010000:00080000:1.0:1787430872.341148:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e2b03d8a300 x1874256847845504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430872.341171:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847845504:0@lo:400:kworker.0 00010000:00010000:3.0:1787430873.090489:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430874.112071:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430874.880770:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430874.880853:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847845632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430874.880916:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430874.881140:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847845632 00000100:00100000:3.0:1787430874.881149:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847845632 00000100:00100000:3.0:1787430874.881209:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787430874.881218:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847845632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787430874.881244:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787430874.881297:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847845632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430874.881304:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787430874.881357:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847845632:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787430874.881534:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1787430875.116578:0:15329:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787430875.129359:0:15329:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787430875.129420:0:15329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.129453:0:15329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.129461:0:15329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.129469:0:15329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.129487:0:15329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787430875.129492:0:15329:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787430875.129520:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430875.129524:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787430875.129531:0:15329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787430875.129537:0:15329:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c10800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787430875.129542:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430875.129544:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787430875.129548:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787430875.130754:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430875.130765:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.132684:0:15329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.132702:0:15329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.132710:0:15329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.132716:0:15329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.132752:0:15329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430875.134374:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430875.134381:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134392:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430875.134399:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430875.134405:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430875.134408:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787430875.134411:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787430875.134467:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134474:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430875.134513:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134520:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03800/0x4dbb683ba6a93fed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134535:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430875.134540:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134545:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8bc00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430875.134548:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134554:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430875.134560:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430875.134565:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430875.134567:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1787430875.134579:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134584:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430875.134615:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134633:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8bc00/0x4dbb683ba6a93ffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94002 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.134642:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430875.134644:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430875.134880:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430875.134901:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847845760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430875.134972:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430875.135110:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430875.135125:0:15329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.135135:0:15329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.135142:0:15329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.135149:0:15329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430875.135596:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847845760 00000100:00100000:1.0:1787430875.135621:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847845760 00000100:00100000:1.0:1787430875.135662:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787430875.135670:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c115b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3629:x1874256847845760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787430875.135676:0:6483:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787430875 with bad export cookie 5601185166973811387 00000100:00100000:0.0:1787430875.142012:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430875.142080:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847845888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430875.142157:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430875.142364:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847845888 00000100:00100000:0.0:1787430875.142373:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847845888 00000100:00100000:0.0:1787430875.142421:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430875.142429:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3628:x1874256847845888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787430875.142436:0:10313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787430875 with bad export cookie 5601185166973811387 00000100:00100000:0.0:1787430875.142485:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3628:x1874256847845888:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (328us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787430875.142492:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787430875.142539:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787430875.142543:0:3628:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787430875.142547:0:3628:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787430875.142652:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430875.142662:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.142672:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430875.142676:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.142685:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430875.142693:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430875.142698:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430875.142700:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787430875.142945:0:15329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1787430875.142954:0:15329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787430875.142993:0:15329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.143002:0:15329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.143009:0:15329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.143015:0:15329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.143029:0:15329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430875.143044:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430875.143049:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.143055:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:2.0:1787430875.143058:0:10373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.143065:0:10373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430875.143072:0:10373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430875.143077:0:10373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787430875.143079:0:10373:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787430875.143081:0:10373:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787430875.144991:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430875.145091:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c115b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3629:x1874256847845760:12345-0@lo:103:ldlm_bl.0 Request processed in 9416us (10114us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787430875.145103:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787430875.145165:0:3629:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787430875.154142:0:3628:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.125@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787430875.154147:0:3628:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787430875.154157:0:3628:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b04d1a300 x1874256847844480/t0(0) o400->MGC192.168.202.125@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787430888 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430875.154185:0:3628:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03b18a80 x1874256847845760/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787430891 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430875.154196:0:3628:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03b1b100 x1874256847845888/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787430891 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787430875.154205:0:3628:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787430875.154208:0:3628:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787430875.154209:0:3628:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:3.0:1787430875.154365:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430875.154399:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3627:1874256847844480:0@lo:400:kworker.0 00010000:00010000:3.0:1787430875.154444:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154454:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430875.154471:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154498:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef600/0x4dbb683ba6a93ed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a93edc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430875.154521:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430875.154531:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:0:1874256847846016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430875.154544:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430875.154546:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430875.154548:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430875.154578:0:15329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154587:0:15329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154593:0:15329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154614:0:15329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154631:0:15329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787430875.154636:0:15329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1787430875.154641:0:15329:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787430875.154676:0:15329:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787430875.154681:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787430875.154686:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430875.154691:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787430875.154696:0:15329:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e2b034c0000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787430875.154702:0:15329:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8e2c36602000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787430875.154713:0:15329:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8e2c3a5b19b8) has exports, disconnecting them 00000020:00080000:3.0:1787430875.154718:0:15329:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e2b034c0000), last request at 1787430872 00000020:00000080:3.0:1787430875.154725:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e9d 00000100:00080000:3.0:1787430875.154742:0:15329:0:(import.c:65:import_set_state_nolock()) ffff8e2b034c3000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787430875.154847:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430875.154853:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154861:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c00030000 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430875.154865:0:10372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154874:0:10372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430875.154881:0:10372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430875.154887:0:10372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430875.154889:0:10372:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787430875.154891:0:10372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787430875.154901:0:10372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:3.0:1787430875.154905:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154912:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c00030000/0x4dbb683ba6a93bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93bc5 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430875.154924:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430875.154926:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430875.154933:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787430875.154948:0:15329:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2b034c0000): rc 0 00000020:00000080:3.0:1787430875.154951:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2b034c0000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787430875.154968:0:15329:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e2c36602000), last request at 1787430872 00000020:00000080:3.0:1787430875.154972:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93d77 00000100:00080000:3.0:1787430875.154977:0:15329:0:(import.c:65:import_set_state_nolock()) ffff8e2c36601800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787430875.154988:0:15329:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2c36602000): rc 0 00000020:00000080:3.0:1787430875.154990:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c36602000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787430875.154997:0:15329:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9cc94151fae0 00000100:00080000:3.0:1787430875.155017:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430875.155023:0:15329:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8e2b03b19c00 x1874256847841152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787430875 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430875.155032:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1787430875.155927:0:10373:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.155939:0:10373:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430875.155958:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.155966:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ef200/0x4dbb683ba6a9426a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4dbb683ba6a94271 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430875.155978:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430875.155980:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430875.155983:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430875.156065:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430875.156079:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:0:1874256847846144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430875.156117:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430875.156225:0:15329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787430875.156230:0:15329:0:(import.c:65:import_set_state_nolock()) ffff8e2c3b9e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1787430875.156275:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787430875.156570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b034c0000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787430875.156680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c36602000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787430875.156700:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b034c3000 for lustre-MDT0001 00000020:00000080:3.0:1787430875.156704:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c36601800 for lustre-MDT0001 00000100:00080000:2.0:1787430875.156990:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787430875.156994:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1787430875.157006:0:15329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787430875.157073:0:15329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787430875.157089:0:15329:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c12800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787430875.157102:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787430875.157104:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1787430875.157112:0:15329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787430875.157186:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847846272:0@lo:9:umount.0 00000100:00100000:2.0:1787430875.157247:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430875.157301:0:11754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847846272 00000100:00100000:2.0:1787430875.157309:0:11754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847846272 00000100:00100000:2.0:1787430875.157350:0:11754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787430875.157360:0:11754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1874256847846272:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787430875.157382:0:11754:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93dc4 00000100:00080000:2.0:1787430875.157390:0:11754:0:(import.c:65:import_set_state_nolock()) ffff8e2b021a8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430875.157427:0:11754:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787430875.157555:0:11754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3626:x1874256847846272:12345-0@lo:9:umount.0 Request processed in 196us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430875.157563:0:11754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:2.0:1787430875.157585:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430875.157631:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c35c12800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787430875.157639:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787430875.157641:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787430875.157644:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847846272:0@lo:9:umount.0 00000100:00080000:2.0:1787430875.157665:0:15329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787430875.157675:0:15329:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b44800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787430875.157701:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847846400:0@lo:9:umount.0 00000100:00100000:2.0:1787430875.157727:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430875.157759:0:8830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847846400 00000100:00100000:2.0:1787430875.157763:0:8830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847846400 00000100:00100000:2.0:1787430875.157887:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787430875.157894:0:8830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874256847846400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787430875.157907:0:8830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93f06 00000100:00080000:2.0:1787430875.157913:0:8830:0:(import.c:65:import_set_state_nolock()) ffff8e2c3f8d2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430875.157934:0:8830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787430875.158016:0:8830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3626:x1874256847846400:12345-0@lo:9:umount.0 Request processed in 122us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430875.158023:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787430875.158051:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b44800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787430875.158059:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787430875.158060:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787430875.158063:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847846400:0@lo:9:umount.0 00010000:00010000:2.0:1787430875.158079:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787430875.158103:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8e2c3a5b19b8) has no exports 00000100:00080000:1.0:1787430875.158179:0:3629:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e2c109e6000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1787430875.158195:0:6493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430875.158259:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3629:1874256847845760:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787430875.159035:0:3628:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787430875.159043:0:3628:0:(import.c:510:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 128 00000100:00080000:0.0:1787430875.159050:0:3628:0:(import.c:624:import_select_connection()) MGC192.168.202.125@tcp: import ffff8e2c109e6000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430875.159512:0:3628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03ae2300 x1874256847846528/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430875.159540:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847846528:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787430875.159580:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874256847846528 offset 0 length 520: 4 00000100:00100000:0.0:1787430875.159640:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847841152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430875.159661:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3628:1874256847845888:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787430875.164925:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8e2c3a5b19b8) has no exports 00000020:01000000:0.0:1787430875.201055:0:15329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2b03752ae0 - data ffff8e2b02432510/ffff8e2b03875c00 00000020:01000000:0.0:1787430875.201212:0:15329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2c3ba90d80 - data ffff8e2c40253af8/ffff8e2c35cd2400 00000001:00000004:0.0:1787430875.210727:0:15329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1787430875.251170:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787430875.251179:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787430875.251188:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787430875.252907:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787430875.252913:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787430875.252935:0:15329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787430875.252937:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787430875.253306:0:8814:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787430875.253311:0:8814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1787430875.253321:0:8814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787430875.253861:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787430875.253865:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787430875.253881:0:15329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787430875.253883:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787430875.254239:0:9544:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787430875.254244:0:9544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1787430875.254251:0:9544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787430875.255517:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93be1 00000020:00000080:2.0:1787430875.255529:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c2fd26000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787430875.256053:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c2fd26000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787430875.257738:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93bf6 00000020:00000080:0.0:1787430875.257750:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c2fd20000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787430875.257934:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787430875.257940:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430875.257949:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787430875.257954:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8e2c3a5b3370) has no exports 00000004:01000000:0.0:1787430875.258109:0:15329:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787430875.258118:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93eff 00000020:00000080:0.0:1787430875.258123:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2b03b43800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787430875.258994:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c2fd20000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787430875.262120:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787430875.262135:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430875.262149:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787430875.262154:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8e2b0355b370) has no exports 00000020:00000080:0.0:1787430875.262164:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93ef8 00000020:00000080:0.0:1787430875.262173:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2b03b40000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787430875.262560:0:15329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787430875.262564:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787430875.262569:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787430875.262574:0:15329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430875.262577:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787430875.262627:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430875.262634:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787430875.262641:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93dbd 00000020:00000080:0.0:1787430875.262646:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2b02878800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787430875.262651:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787430875.262654:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430875.262658:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787430875.262661:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8e2c35c4b370) has no exports 00000020:00000080:0.0:1787430875.262675:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93db6 00000020:00000080:0.0:1787430875.262678:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2b02878000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787430875.262898:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03b43800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787430875.262907:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03b40000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787430875.262912:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03b44800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787430875.262917:0:9961:0:(genops.c:885:class_export_put()) final put ffff8e2b03896000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787430875.262920:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03896000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787430875.262924:0:9961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787430875.263004:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b02878800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787430875.263009:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b02878000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787430875.263556:0:15329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787430875.263560:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787430875.263562:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1787430875.263566:0:15329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430875.263568:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787430875.263630:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430875.263636:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787430875.263651:0:15329:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787430875.263659:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93c19 00000020:00000080:0.0:1787430875.263665:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c2fd27000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787430875.263669:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787430875.263673:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430875.263676:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787430875.263680:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8e2c3a7999b8) has no exports 00000020:00000080:0.0:1787430875.263684:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93c12 00000020:00000080:0.0:1787430875.263687:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c3b9ed000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787430875.264753:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c35c12800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787430875.264764:0:9961:0:(genops.c:885:class_export_put()) final put ffff8e2b0287e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787430875.264776:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0287e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787430875.264793:0:9961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787430875.264862:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c2fd27000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787430875.264867:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3b9ed000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787430875.284676:0:15329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787430875.284685:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430875.284690:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787430875.284699:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787430875.284749:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430875.284759:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787430875.284810:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430875.284814:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787430875.284820:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c3a676000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787430875.284825:0:15329:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a676000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787430875.284846:0:15329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787430875.285011:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93bfd 00000020:00000080:2.0:1787430875.285018:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c2fd23000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787430875.285033:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787430875.285037:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430875.285042:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787430875.285045:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8e2c3a5b0000) has no exports 00000020:00000080:2.0:1787430875.285064:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430875.285068:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787430875.285072:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93c04 00000020:00000080:2.0:1787430875.285076:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c2fd20800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787430875.285083:0:15329:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c3a6a2800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787430875.285086:0:15329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c3a6a2800 2 00000020:01000004:2.0:1787430875.285090:0:15329:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e2c3a6a2800 from lustre-MDT0001 00000020:00000080:2.0:1787430875.285107:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430875.285110:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787430875.285112:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c2fd24000/lustre-MDT0001_UUID 00000020:00000080:2.0:1787430875.285115:0:15329:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c2fd24000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787430875.285123:0:15329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787430875.285151:0:15329:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787430875.285155:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787430875.285158:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430875.285161:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787430875.285168:0:15329:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8e2c35c17000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787430875.285173:0:15329:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8e2c35c499b8) has exports, disconnecting them 00000020:00080000:2.0:1787430875.285177:0:15329:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8e2c35c17000), last request at 1787430680 00000020:00000080:2.0:1787430875.285181:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93c58 00000020:00080000:2.0:1787430875.285193:0:15329:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2c35c17000): rc 0 00000020:00000080:2.0:1787430875.285197:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c35c17000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787430875.285943:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3b9e9000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787430875.285953:0:9961:0:(genops.c:885:class_export_put()) final put ffff8e2c3b9c5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787430875.285963:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3b9c5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787430875.285973:0:9961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787430875.286074:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c2fd23000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787430875.286078:0:9961:0:(genops.c:885:class_export_put()) final put ffff8e2c2fd22000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787430875.286080:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c2fd22000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787430875.286083:0:9961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787430875.286293:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c2fd20800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787430875.286298:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c35c17000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787430875.286332:0:15329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787430875.286336:0:15329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430875.286339:0:15329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787430875.286343:0:15329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787430875.286360:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c35c10800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787430875.286493:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430875.286499:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787430875.286502:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c07756800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787430875.286504:0:15329:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c07756800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787430875.286508:0:15329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787430875.286536:0:15329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c3a6a2800 1 00000020:00000080:3.0:1787430875.286542:0:15329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93b94 00000020:00000080:3.0:1787430875.286546:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c3a6a6800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787430875.286555:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787430875.286562:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a6a6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787430875.286571:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430875.286575:0:15329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787430875.286579:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8e2c3a79b370) has no exports 00000020:00000080:3.0:1787430875.360359:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430875.360375:0:15329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787430875.360380:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c3a6a7800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787430875.360395:0:15329:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a6a7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787430875.360407:0:15329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787430875.360529:0:15329:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e2c3a6a3800 00000020:01000000:3.0:1787430875.360548:0:15329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787430875.360553:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430875.360557:0:15329:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787430875.360560:0:15329:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8e2c10963370) has no exports 00000100:00100000:0.0:1787430875.360920:0:6499:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8e2c40512400:6499] 2 exiting: rc = 0 00000100:00100000:0.0:1787430875.361033:0:10098:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8e2b034afe00:10098] 4 exiting: rc = 0 00000100:00100000:0.0:1787430875.361114:0:6498:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8e2c328f9200:6498] 1 exiting: rc = 0 00000100:00100000:0.0:1787430875.361190:0:8819:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8e2b02871200:8819] 3 exiting: rc = 0 00000100:00100000:0.0:1787430875.361291:0:6496:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8e2c11653400:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1787430875.361495:0:13789:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff8e2b03c02200:13789] 5 exiting: rc = 0 00000100:00100000:3.0:1787430875.361661:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361667:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361671:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361675:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361679:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361683:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361686:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361690:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361693:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361697:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361700:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361703:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361707:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361710:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361713:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361717:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361721:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361724:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361728:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361732:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361735:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361738:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361741:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361744:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361747:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361751:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361754:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361764:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361837:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361845:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361850:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361855:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361860:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361866:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361872:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361878:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361884:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361890:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361895:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361901:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361906:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361911:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361915:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361918:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361922:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361925:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361928:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361932:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361935:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361938:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361941:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361945:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361949:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361952:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361955:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361958:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361962:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361965:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361969:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361973:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361976:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361979:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.361989:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.362004:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.365031:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e2c06432200:6501] 1 exiting: rc = 0 00000100:00100000:2.0:1787430875.365174:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e2c404fb000:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1787430875.365321:0:14591:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8e2b048eb400:14591] 2 exiting: rc = 0 00000100:00100000:3.0:1787430875.365422:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365430:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365435:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365440:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365447:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365454:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365460:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365466:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365471:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365477:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365483:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365489:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365495:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365500:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365505:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365510:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365516:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365521:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365526:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365532:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365538:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365543:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365548:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365553:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365558:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365563:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365569:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365575:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365580:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365585:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365590:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365596:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365757:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365866:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365872:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365878:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365884:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365889:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365894:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365899:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365904:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365908:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365913:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365918:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365924:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365929:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365934:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365939:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365944:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365949:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365954:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365958:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365963:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365968:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365973:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365978:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365982:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365986:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365991:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365995:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.365999:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.366003:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.366007:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.366011:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430875.367026:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8e2c136db800:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1787430875.367286:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8e2c088fba00:6503] 1 exiting: rc = 0 00000100:00100000:2.0:1787430875.367380:0:8069:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8e2c3a66fc00:8069] 2 exiting: rc = 0 00000100:00100000:3.0:1787430875.367501:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367530:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367537:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367543:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367560:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367566:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367573:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367579:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367586:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367593:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367760:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367778:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367794:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367816:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367823:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367830:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367836:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367842:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367848:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367854:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367860:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367866:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367872:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367878:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367885:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367903:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367909:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367915:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367922:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367928:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367935:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367940:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367946:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367952:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367958:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367965:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367972:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.367993:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368000:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368013:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368019:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368025:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368034:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368040:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368047:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368053:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368059:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368065:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368071:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368094:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368102:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368108:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368115:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368121:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368127:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368134:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368140:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368146:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368151:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368157:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368163:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368170:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368176:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.368183:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430875.376236:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e2c088fb800:6505] 1 exiting: rc = 0 00000100:00100000:3.0:1787430875.376517:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e2c088fa600:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1787430875.376636:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376643:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376648:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376653:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376658:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376663:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376667:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376671:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376686:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376691:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376696:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376700:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376704:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376709:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376714:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376718:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376722:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376727:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376732:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376736:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376741:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376746:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376750:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376755:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376760:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376764:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376842:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376848:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376853:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376857:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376862:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376866:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376870:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376875:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376881:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376885:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376890:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376895:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376899:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376904:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376909:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376913:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376918:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376934:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376939:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376944:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376949:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376954:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376959:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376964:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376969:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376974:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376979:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376984:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376990:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376994:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.376999:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377004:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377009:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377014:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377018:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377022:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377027:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377031:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377383:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e2c088fa800:6506] 0 exiting: rc = 1 00000100:00100000:3.0:1787430875.377506:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e2c088fb200:6507] 1 exiting: rc = 0 00000100:00100000:1.0:1787430875.377588:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377594:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377671:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377681:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377687:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377693:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377699:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377705:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377711:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377717:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377723:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377728:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377733:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377746:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377752:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377758:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377764:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377850:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377856:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377862:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377868:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377873:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377878:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377883:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377888:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377893:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377899:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377903:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377908:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377914:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377918:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377923:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377928:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377933:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377938:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377943:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377949:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377955:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377960:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377965:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377970:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377975:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377981:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377986:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377991:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.377995:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378000:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378005:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378018:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378023:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378027:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378033:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378038:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378042:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378047:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378051:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378056:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378061:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378067:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378072:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378077:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378082:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378087:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430875.378093:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.379119:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e2c227c7000:6508] 0 exiting: rc = 1 00000100:00100000:0.0:1787430875.379932:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e2c227c6600:6509] 1 exiting: rc = 0 00000100:00100000:3.0:1787430875.380307:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380314:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380319:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380324:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380329:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380335:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380340:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380355:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380359:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380364:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380368:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380373:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380377:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380381:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380386:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380391:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380396:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380401:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380407:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380413:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380418:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380423:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380428:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380434:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380439:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380444:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380450:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380454:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380460:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380465:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380470:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380475:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380479:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380484:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380489:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380496:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380501:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380506:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380512:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380517:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380522:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380527:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380539:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380544:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380550:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380555:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380560:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380565:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380570:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380574:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380579:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380583:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380588:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380593:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380597:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380895:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380901:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380906:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380911:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380917:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380922:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380927:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380933:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.380938:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382045:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8e2c2e248000:6510] 0 exiting: rc = 1 00000100:00100000:2.0:1787430875.382426:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8e2c2e248600:6511] 1 exiting: rc = 0 00000100:00100000:0.0:1787430875.382592:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8e2c08a99000:6512] 2 exiting: rc = 0 00000100:00100000:3.0:1787430875.382890:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382896:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382902:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382922:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382929:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382934:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382940:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382945:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382952:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382957:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382963:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382969:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382984:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382990:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.382996:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383002:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383007:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383012:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383018:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383024:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383029:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383034:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383039:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383044:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383049:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383054:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383060:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383079:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383085:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383091:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383097:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383102:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383108:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383114:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383121:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383127:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383133:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383139:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383144:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383151:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383157:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383162:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383168:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383174:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383179:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383199:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383272:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383284:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383289:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383295:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383301:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383320:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383326:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383332:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383337:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383343:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383348:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383353:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383359:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383364:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383370:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383375:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383381:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430875.383386:0:15329:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787430875.390038:0:15329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430875.390061:0:15329:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787430875.390067:0:15329:0:(genops.c:885:class_export_put()) final put ffff8e2c109e5800/MDS_uuid 00000020:00000080:2.0:1787430875.390072:0:15329:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c109e5800/MDS_uuid for MDS 00000020:01000000:2.0:1787430875.390080:0:15329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787430875.390370:0:15329:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787430876.160874:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430877.184730:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787430877.441749:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787430877.441758:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430877.441761:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787430877.441783:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787430877.441787:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787430877.441795:0:9961:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 333 00000100:00080000:0.0:1787430877.441801:0:9961:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787430877.441808:0:9961:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e2b0287c800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430877.441843:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03ae0a80 x1874256847846656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787430877.441895:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787430877.441898:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787430877.441901:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787430877.441904:0:9961:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 333 00000100:00080000:0.0:1787430877.441906:0:9961:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787430877.441909:0:9961:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2b03894000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430877.441920:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03ae2680 x1874256847846912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430877.441963:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430877.441979:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847846784:0@lo:400:kworker.0 00000400:00000100:0.0:1787430877.442048:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847846784 offset 0 length 224: 4 00000100:00100000:0.0:1787430877.442102:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430877.442111:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847847040:0@lo:400:kworker.0 00000400:00000100:0.0:1787430877.442131:0:3628:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847847040 offset 0 length 224: 4 00000100:00100000:2.0:1787430877.442262:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847846656:0@lo:38:kworker.0 00000400:00000100:2.0:1787430877.442288:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847846656 offset 0 length 520: 4 00000100:00100000:2.0:1787430877.442303:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847846912:0@lo:38:kworker.0 00000400:00000100:2.0:1787430877.442319:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847846912 offset 0 length 520: 4 00010000:00010000:3.0:1787430878.211817:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787430878.271294:0:15531:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787430878.283810:0:15531:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787430878.283857:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430878.283872:0:15531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430878.283878:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430878.283885:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430878.283906:0:15531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787430878.283910:0:15531:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787430878.284021:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430878.284033:0:15531:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03ae0a80 x1874256847846656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787430902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430878.284101:0:15531:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787430878.284119:0:15531:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787430878.284125:0:15531:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787430878.284130:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430878.284134:0:15531:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03ae0a80 x1874256847846656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787430902 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430878.284240:0:15531:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787430878.284256:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847846656:0@lo:38:kworker.0 00000100:00100000:2.0:1787430878.284307:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787430878.284551:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430878.284559:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430878.284577:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430878.284580:0:10373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430878.284588:0:10373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430878.284594:0:10373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430878.284614:0:10373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430878.284618:0:10373:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787430878.284620:0:10373:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787430878.284633:0:10373:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:0.0:1787430878.284637:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430878.284644:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a93fd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430878.284655:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430878.284657:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430878.284659:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430878.285599:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787430878.285722:0:15531:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03ae1f80 x1874256847846784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430878.285790:0:15531:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787430878.285796:0:15531:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787430878.285819:0:15531:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787430878.285887:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1874256847847168:0@lo:39:umount.0 00000400:00000100:3.0:1787430878.285947:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847847168 offset 0 length 224: 4 00000100:00100000:0.0:1787430878.286103:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847846784:0@lo:400:kworker.0 00010000:00010000:2.0:1787430879.232349:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430880.257815:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430880.447787:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430880.447797:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787430880.447800:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430880.447803:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787430880.448111:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847847296:0@lo:400:kworker.0 00000400:00000100:0.0:1787430880.448179:0:3628:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847847296 offset 0 length 224: 4 00000001:00100000:2.0:1787430880.521159:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787430880.521168:0:9485:0:(genops.c:885:class_export_put()) final put ffff8e2c3f8d5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787430880.521251:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3f8d5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787430880.521306:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c3f8d2000 for lustre-OST0001 00000001:00100000:0.0:1787430880.521712:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787430880.521727:0:8404:0:(genops.c:885:class_export_put()) final put ffff8e2b021ac800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787430880.521798:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b021ac800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787430880.532118:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b021a8000 for lustre-OST0000 00010000:00010000:3.0:1787430881.279781:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430882.303826:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430882.495838:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430882.495848:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787430882.495851:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430882.495854:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787430882.495947:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847847424:0@lo:400:kworker.0 00000400:00000100:0.0:1787430882.496001:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847847424 offset 0 length 224: 4 00010000:00010000:2.0:1787430883.328035:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430884.353450:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430885.375994:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430885.439739:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430875/real 1787430875] req@ffff8e2b03ae2300 x1874256847846528/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787430885 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430885.439777:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b03ae2300 x1874256847846528/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787430885 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430885.439799:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430885.439824:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787430885.439829:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847846528:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1787430885.441053:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430885.441062:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787430885.441083:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430885.441089:0:9961:0:(import.c:510:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 336 00000100:00080000:1.0:1787430885.441095:0:9961:0:(import.c:589:import_select_connection()) MGC192.168.202.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787430885.441101:0:9961:0:(import.c:624:import_select_connection()) MGC192.168.202.125@tcp: import ffff8e2c109e6000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430885.441132:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac3100 x1874256847847552/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430885.441162:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430885.441167:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787430885.441249:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430885.441267:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847847680:0@lo:400:kworker.0 00000400:00000100:0.0:1787430885.441391:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847847680 offset 0 length 224: 4 00000100:00100000:2.0:1787430885.441471:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847847552:0@lo:250:kworker.0 00000400:00000100:2.0:1787430885.441497:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874256847847552 offset 0 length 520: 4 00010000:00010000:0.0:1787430886.399900:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430887.424260:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430888.447807:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430888.511879:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430878/real 1787430878] req@ffff8e2b03d8b100 x1874256847847168/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430888 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430888.511911:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b03d8b100 x1874256847847168/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430888 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430888.511932:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787430888.511955:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1874256847847168:0@lo:39:umount.0 00000100:00080000:1.0:1787430888.512032:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787430888.512037:0:15531:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787430888.512042:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787430888.512883:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513237:0:15531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513248:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513255:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513279:0:15531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430888.513287:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513294:0:15531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513317:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513324:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430888.513340:0:15531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787430888.513345:0:15531:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787430888.513369:0:15531:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787430888.513374:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787430888.513378:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787430888.513383:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787430888.513388:0:15531:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8e2c3a79cd28) has no exports 00010000:00010000:3.0:1787430888.513390:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430888.513399:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787430888.513410:0:15531:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8e2c3a79cd28) has no exports 00010000:00010000:3.0:1787430888.513418:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03e00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430888.513423:0:10372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430888.513432:0:10372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430888.513439:0:10372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430888.513444:0:10372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430888.513447:0:10372:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787430888.513449:0:10372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787430888.513461:0:10372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:3.0:1787430888.513464:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430888.513470:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03e00/0x4dbb683ba6a93fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430888.513484:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430888.513487:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430888.513494:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01490200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430888.513497:0:10372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430888.513503:0:10372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430888.513516:0:10372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430888.513522:0:10372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787430888.513524:0:10372:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787430888.513525:0:10372:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787430888.513531:0:10372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:3.0:1787430888.513533:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430888.513539:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c01490200/0x4dbb683ba6a9425c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a94263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430888.513550:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430888.513552:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430888.513553:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430888.514578:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787430888.515909:0:15531:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2c35dc5de0 - data ffff8e2c40362000/ffff8e2c3f866800 00000020:01000000:1.0:1787430888.516074:0:15531:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2b0231af60 - data ffff8e2c401871b0/ffff8e2b023f2800 00100000:10000000:1.0:1787430888.528786:0:15531:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787430888.534876:0:15531:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93d31 00000020:00000080:0.0:1787430888.534887:0:15531:0:(genops.c:885:class_export_put()) final put ffff8e2b021aa800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787430888.535893:0:15531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c35f42000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787430888.535900:0:15531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c35f42000 2 00000020:01000004:0.0:1787430888.535903:0:15531:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e2c35f42000 from lustre-OST0000 00000020:00000080:0.0:1787430888.535930:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430888.535941:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787430888.535944:0:15531:0:(genops.c:885:class_export_put()) final put ffff8e2b021ab000/lustre-OST0000_UUID 00000020:00000080:0.0:1787430888.535948:0:15531:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b021ab000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787430888.535956:0:15531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787430888.536012:0:15531:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787430888.536016:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787430888.536019:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430888.536023:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787430888.536028:0:15531:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e2b0287c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787430888.536033:0:15531:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8e2c35c48000) has exports, disconnecting them 00000020:00080000:0.0:1787430888.536037:0:15531:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e2b0287c000), last request at 1787430691 00000020:00000080:0.0:1787430888.536040:0:15531:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93d5b 00000020:00080000:0.0:1787430888.536889:0:15531:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2b0287c000): rc 0 00000020:00000080:0.0:1787430888.537552:0:15531:0:(genops.c:885:class_export_put()) final put ffff8e2b0287c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787430888.539355:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b021aa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:3.0:1787430888.541348:0:15531:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787430888.541357:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430888.541361:0:15531:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787430888.541369:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787430888.542060:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430888.542072:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787430888.542081:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787430888.542086:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430888.542091:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787430888.542141:0:15531:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8e2b0287a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787430888.542148:0:15531:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8e2c35c4cd28) has exports, disconnecting them 00000020:00080000:3.0:1787430888.542153:0:15531:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8e2b0287a000), last request at 1787430691 00000020:00000080:3.0:1787430888.542166:0:15531:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93d70 00000020:00080000:3.0:1787430888.542183:0:15531:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2b0287a000): rc 0 00000020:00000080:3.0:1787430888.542189:0:15531:0:(genops.c:885:class_export_put()) final put ffff8e2b0287a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787430888.544882:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0287c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787430888.545412:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b0287c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787430888.545508:0:9961:0:(genops.c:885:class_export_put()) final put ffff8e2c3a6a7000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787430888.545516:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c3a6a7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787430888.545522:0:9961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787430888.545598:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0287a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787430888.545679:0:15531:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787430888.545684:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787430888.545688:0:15531:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787430888.545694:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787430888.545724:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b0287d800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787430888.547219:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430888.547233:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787430888.547238:0:15531:0:(genops.c:885:class_export_put()) final put ffff8e2b0287e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787430888.547242:0:15531:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0287e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787430888.547247:0:15531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787430888.547301:0:15531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c35f42000 1 00000020:00000080:2.0:1787430888.547859:0:15531:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93cf9 00000020:00000080:2.0:1787430888.547878:0:15531:0:(genops.c:885:class_export_put()) final put ffff8e2c35e6e800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787430888.547897:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787430888.547913:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c35e6e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787430888.547928:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430888.547935:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787430888.547939:0:15531:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8e2c3a798000) has no exports 00000020:00000080:2.0:1787430888.627111:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430888.627126:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787430888.627132:0:15531:0:(genops.c:885:class_export_put()) final put ffff8e2c35f40800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787430888.627136:0:15531:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c35f40800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787430888.627149:0:15531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787430888.627268:0:15531:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e2c35f41000 00000020:02000400:2.0:1787430888.627315:0:15531:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787430889.471738:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430890.507285:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430890.755011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787430890.755020:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430890.755024:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787430890.755027:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787430890.755102:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847847808:0@lo:400:kworker.0 00000400:00000100:3.0:1787430890.755168:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847847808 offset 0 length 224: 4 00010000:00010000:1.0:1787430891.530166:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787430891.649807:0:15734:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787430891.668836:0:15734:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787430891.668928:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430891.668945:0:15734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430891.668953:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430891.668981:0:15734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430891.669009:0:15734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787430891.669015:0:15734:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787430891.669049:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787430891.669061:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03ae2680 x1874256847846912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787430902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787430891.669067:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430891.669074:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430891.669082:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eec00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430891.669086:0:10373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430891.669094:0:10373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430891.669102:0:10373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430891.669107:0:10373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430891.669110:0:10373:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787430891.669112:0:10373:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787430891.669125:0:10373:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:0.0:1787430891.669129:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430891.669133:0:15734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787430891.669136:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360eec00/0x4dbb683ba6a93fb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fbc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787430891.669139:0:15734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787430891.669144:0:15734:0:(import.c:65:import_set_state_nolock()) ffff8e2b03894000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1787430891.669145:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430891.669147:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430891.669149:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1787430891.669149:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430891.669153:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03ae2680 x1874256847846912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787430902 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430891.672879:0:15734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787430891.672941:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847846912:0@lo:38:kworker.0 00000100:00100000:1.0:1787430891.673246:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787430891.674408:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787430891.674420:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03ae3100 x1874256847847040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430891.674502:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b04ac3800 x1874256847847296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430896 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430891.674511:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b04ac1f80 x1874256847847424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430891.674701:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b04ac0380 x1874256847847680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430901 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430891.674710:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b03b18700 x1874256847847808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430906 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430891.674730:0:15734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787430891.674737:0:15734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787430891.674762:0:15734:0:(import.c:65:import_set_state_nolock()) ffff8e2b03890000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787430891.674846:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847847808:0@lo:400:kworker.0 00000100:00100000:2.0:1787430891.674877:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1874256847847936:0@lo:39:umount.0 00000400:00000100:2.0:1787430891.674923:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256847847936 offset 0 length 224: 4 00000100:00100000:3.0:1787430891.674986:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847847296:0@lo:400:kworker.0 00000100:00100000:3.0:1787430891.674995:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847847040:0@lo:400:kworker.0 00000100:00100000:1.0:1787430891.675841:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847847424:0@lo:400:kworker.0 00000100:00100000:0.0:1787430891.675929:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847847680:0@lo:400:kworker.0 00010000:00010000:2.0:1787430892.543774:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430893.568659:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430894.591930:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430895.615748:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430895.871822:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430895.871830:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787430896.639747:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430897.664628:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430898.688132:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430899.711923:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430900.735756:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430900.927732:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430885/real 1787430885] req@ffff8e2b04ac3100 x1874256847847552/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787430900 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430900.927767:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b04ac3100 x1874256847847552/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787430900 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787430900.927788:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787430900.927885:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787430900.927891:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847847552:0@lo:250:kworker.0 00000100:00080000:1.0:1787430900.928793:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430900.928801:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787430900.928804:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430900.928810:0:9961:0:(import.c:510:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 346 00000100:00080000:1.0:1787430900.928816:0:9961:0:(import.c:589:import_select_connection()) MGC192.168.202.125@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787430900.928822:0:9961:0:(import.c:624:import_select_connection()) MGC192.168.202.125@tcp: import ffff8e2c109e6000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430900.928866:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac1f80 x1874256847848064/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430900.929634:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847848064:0@lo:250:kworker.0 00000400:00000100:0.0:1787430900.929692:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874256847848064 offset 0 length 520: 4 00010000:00010000:0.0:1787430901.759782:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430901.951730:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430891/real 1787430891] req@ffff8e2b03ae1f80 x1874256847847936/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430901.951765:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b03ae1f80 x1874256847847936/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787430901.951785:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03890000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787430901.951810:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1874256847847936:0@lo:39:umount.0 00000100:00080000:1.0:1787430901.951898:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787430901.951903:0:15734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787430901.951907:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787430901.952848:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952861:0:15734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952869:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952875:0:15734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952901:0:15734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430901.952908:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952915:0:15734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952921:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952927:0:15734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430901.952947:0:15734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787430901.952964:0:15734:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787430901.952986:0:15734:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787430901.952990:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787430901.952995:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787430901.953000:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787430901.953004:0:15734:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8e2b036299b8) has no exports 00000020:00080000:1.0:1787430901.953026:0:15734:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8e2b036299b8) has no exports 00010000:00010000:3.0:1787430901.953259:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430901.953267:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953277:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee000 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430901.953281:0:10372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953291:0:10372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430901.953299:0:10372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430901.953317:0:10372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430901.953320:0:10372:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787430901.953322:0:10372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787430901.953337:0:10372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:3.0:1787430901.953342:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953349:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee000/0x4dbb683ba6a93fc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93fca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953364:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430901.953367:0:10372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953374:0:10372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03600 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430901.953377:0:10372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953384:0:10372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430901.953391:0:10372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430901.953396:0:10372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787430901.953398:0:10372:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787430901.953400:0:10372:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787430901.953404:0:10372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:3.0:1787430901.953407:0:10372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953420:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03600/0x4dbb683ba6a9424e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a94255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430901.953432:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430901.953434:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430901.953436:0:10372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787430901.954658:0:15734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2b039a4540 - data ffff8e2c4031aca8/ffff8e2b03b3a800 00000020:01000000:1.0:1787430901.954786:0:15734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2b0231aba0 - data ffff8e2c40356d80/ffff8e2c3f868800 00010000:00010000:0.0:1787430901.955134:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787430901.966552:0:15734:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787430901.978992:0:15734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e57 00000020:00000080:2.0:1787430901.979019:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2b0361e000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787430901.979049:0:15734:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c363a8000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787430901.979053:0:15734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c363a8000 2 00000020:01000004:2.0:1787430901.979056:0:15734:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e2c363a8000 from lustre-OST0001 00000020:00000080:2.0:1787430901.979092:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430901.979102:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787430901.979105:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2b0361f800/lustre-OST0001_UUID 00000020:00000080:2.0:1787430901.979108:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0361f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787430901.979114:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1787430901.979166:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b0361e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1787430901.979230:0:15734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d3f3caeb-2c11-4e8c-831c-fee5cea3edde->MGS 00010000:00010000:2.0:1787430901.979244:0:15734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c00031200/0x4dbb683ba6a93bb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a93bb7 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430901.979257:0:15734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c00031200/0x4dbb683ba6a93bb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a93bb7 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430901.979264:0:15734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787430901.979266:0:15734:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787430901.979270:0:15734:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787430901.979284:0:15734:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:2.0:1787430901.979288:0:15734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c00031200/0x4dbb683ba6a93bb0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a93bb7 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430901.979303:0:15734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4dbb683ba6a9402c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430901.979310:0:15734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4dbb683ba6a9402c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430901.979315:0:15734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787430901.979317:0:15734:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787430901.979319:0:15734:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787430901.979327:0:15734:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2c109e6000 00010000:00010000:2.0:1787430901.979330:0:15734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f1c400/0x4dbb683ba6a94025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4dbb683ba6a9402c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787430901.979358:0:15734:0:(import.c:65:import_set_state_nolock()) ffff8e2c109e6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787430901.979362:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787430901.979364:0:15734:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787430901.979366:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787430901.979370:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787430901.979380:0:15734:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2b04ac1f80 x1874256847848064/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787430920 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787430901.979403:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787430901.979406:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1787430901.979651:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3f3caeb-2c11-4e8c-831c-fee5cea3edde:3626:1874256847848064:0@lo:250:kworker.0 10000000:01000000:2.0:1787430901.980485:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787430901.980494:0:15734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93aad 00000020:00000080:2.0:1787430901.980499:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2c109e4000/d3f3caeb-2c11-4e8c-831c-fee5cea3edde 00000020:01000000:2.0:1787430901.980516:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.125@tcp (flags='') 00000020:00000080:2.0:1787430901.980522:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430901.980527:0:15734:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787430901.980530:0:15734:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8e2c10964d28) has no exports 10000000:01000000:3.0:1787430901.980656:0:6494:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787430901.980700:0:15734:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.125@tcp: client import never connected 00000100:00080000:2.0:1787430901.980704:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787430901.980707:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787430901.980709:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787430901.980711:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787430901.980755:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430901.980760:0:15734:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.125@tcp (uuid d3f3caeb-2c11-4e8c-831c-fee5cea3edde) 00000020:01000000:2.0:1787430901.980765:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787430901.980768:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430901.980771:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787430901.980776:0:15734:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e2b03895000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787430901.980781:0:15734:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8e2b03558000) has exports, disconnecting them 00000020:00080000:2.0:1787430901.980785:0:15734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e2b03895000), last request at 1787430702 00000020:00000080:2.0:1787430901.980789:0:15734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e81 00000020:00080000:2.0:1787430901.980806:0:15734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2b03895000): rc 0 00000020:00000080:2.0:1787430901.980810:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2b03895000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787430901.981756:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c109e4000/d3f3caeb-2c11-4e8c-831c-fee5cea3edde for MGC192.168.202.125@tcp 00000020:00000080:1.0:1787430901.981767:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2c109e6000 for MGC192.168.202.125@tcp 00000020:00000080:1.0:1787430901.981773:0:9961:0:(genops.c:885:class_export_put()) final put ffff8e2c109e6800/d3f3caeb-2c11-4e8c-831c-fee5cea3edde 00000020:00000080:1.0:1787430901.981775:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c109e6800/d3f3caeb-2c11-4e8c-831c-fee5cea3edde for MGC192.168.202.125@tcp 00000020:01000000:1.0:1787430901.981779:0:9961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.125@tcp (d3f3caeb-2c11-4e8c-831c-fee5cea3edde) 00000020:00000080:1.0:1787430901.982018:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03895000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787430901.982658:0:15734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787430901.982663:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430901.982667:0:15734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787430901.982672:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787430901.982850:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430901.982857:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787430901.982862:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787430901.982867:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430901.982870:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787430901.982876:0:15734:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8e2b03894800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787430901.982882:0:15734:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8e2b0355cd28) has exports, disconnecting them 00000020:00080000:3.0:1787430901.982886:0:15734:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8e2b03894800), last request at 1787430702 00000020:00000080:3.0:1787430901.982890:0:15734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e96 00000020:00080000:3.0:1787430901.982903:0:15734:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2b03894800): rc 0 00000020:00000080:3.0:1787430901.982907:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2b03894800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787430901.983166:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03894000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787430901.983173:0:9961:0:(genops.c:885:class_export_put()) final put ffff8e2b02bbe800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787430901.983176:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b02bbe800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787430901.983180:0:9961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787430901.983223:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03894800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787430902.004186:0:15734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787430902.004195:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787430902.004200:0:15734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787430902.004231:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787430902.004269:0:9961:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8e2b03890000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787430902.004300:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787430902.004511:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787430902.004641:0:10372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1787430902.005136:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1787430902.005380:0:6480:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e2c06408c00:6480] 1 exiting: rc = 0 00000100:00100000:1.0:1787430902.005425:0:10312:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8e2b03d75a00:10312] 2 exiting: rc = 0 00000100:00100000:0.0:1787430902.005657:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e2c407e6a00:6479] 0 exiting: rc = 1 00000100:00100000:2.0:1787430902.006102:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006445:0:6481:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e2c2e236c00:6481] 0 exiting: rc = 1 00000100:00100000:1.0:1787430902.006465:0:10313:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8e2b0219da00:10313] 4 exiting: rc = 0 00000100:00100000:2.0:1787430902.006574:0:9495:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e2b0284fe00:9495] 3 exiting: rc = 0 00000100:00100000:2.0:1787430902.006670:0:6483:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e2c040e3a00:6483] 2 exiting: rc = 0 00000100:00100000:1.0:1787430902.006694:0:6482:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e2c2e236e00:6482] 1 exiting: rc = 0 00000100:00100000:2.0:1787430902.006740:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006827:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006839:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006849:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006864:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006871:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006877:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006883:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006888:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006899:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006906:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006911:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006917:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006923:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006928:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006934:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006940:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006945:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006950:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006962:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006975:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006980:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006986:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006992:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.006997:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007003:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007007:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007013:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007025:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007034:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007107:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007115:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007124:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007130:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007135:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007140:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007145:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007155:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007160:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007165:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007170:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007175:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007181:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007186:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007192:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007197:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007202:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007207:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007213:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007218:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007223:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007228:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007234:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007239:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007244:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007255:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007260:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007266:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007271:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007276:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007281:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007287:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007297:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.007303:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787430902.008597:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430902.008626:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787430902.008632:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2b03891800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787430902.008636:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b03891800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787430902.008642:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787430902.008689:0:15734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c363a8000 1 00000020:00000080:2.0:1787430902.008696:0:15734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4dbb683ba6a93e26 00000020:00000080:2.0:1787430902.008704:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2b02bb9000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787430902.008726:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787430902.008731:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430902.008736:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1787430902.008740:0:9961:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2b02bb9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00080000:2.0:1787430902.008819:0:15734:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8e2c35deb370) has no exports 00000020:00000080:3.0:1787430902.040394:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430902.040411:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787430902.040418:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2c363ad000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787430902.040423:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c363ad000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787430902.040429:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787430902.040880:0:15734:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e2c363a9000 00000020:01000000:3.0:1787430902.040917:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787430902.040921:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430902.040926:0:15734:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787430902.040930:0:15734:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8e2c35de8000) has no exports 00000020:00000080:3.0:1787430902.040960:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430902.040965:0:15734:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787430902.040968:0:15734:0:(genops.c:885:class_export_put()) final put ffff8e2c35e6c000/OSS_uuid 00000020:00000080:3.0:1787430902.040971:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2c35e6c000/OSS_uuid for OSS 00000020:01000000:3.0:1787430902.040975:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787430902.041257:0:6493:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787430902.041424:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8e2c35cac000:8411] 2 exiting: rc = 0 00000100:00100000:3.0:1787430902.041671:0:8830:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8e2b0284f400:8830] 3 exiting: rc = 0 00000100:00100000:3.0:1787430902.041716:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8e2c35cad000:8408] 0 exiting: rc = 1 00000100:00100000:3.0:1787430902.041753:0:11754:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8e2b035caa00:11754] 4 exiting: rc = 0 00000100:00100000:2.0:1787430902.041888:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8e2c35cad200:8409] 1 exiting: rc = 0 00000100:00100000:0.0:1787430902.044027:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044040:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044056:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044068:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044075:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044081:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044086:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044091:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044097:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044102:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044107:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044112:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044118:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044124:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044129:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044135:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044154:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044160:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044166:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044172:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044178:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044183:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044188:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044194:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044199:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044204:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044210:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044216:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044221:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044226:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044232:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044237:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044243:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044249:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044255:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044260:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044266:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044271:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044276:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044289:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044301:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044308:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044319:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044325:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044331:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044341:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044347:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044353:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044358:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044363:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044368:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044379:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044384:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044389:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044394:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044399:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044404:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044413:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044422:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044428:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044434:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044439:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044444:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.044450:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045343:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e2c3a4c0200:8412] 0 exiting: rc = 1 00000100:00100000:3.0:1787430902.045732:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e2c3a4c1a00:8413] 1 exiting: rc = 0 00000100:00100000:3.0:1787430902.045791:0:11116:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8e2b035cb400:11116] 2 exiting: rc = 0 00000100:00100000:0.0:1787430902.045915:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045923:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045928:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045933:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045938:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045943:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045947:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045952:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045957:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045962:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045967:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045972:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045976:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045985:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045991:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.045996:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046109:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046117:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046122:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046127:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046132:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046146:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046151:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046155:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046160:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046165:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046170:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046175:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046180:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046185:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046190:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046195:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046200:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046204:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046209:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046214:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046219:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046224:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046228:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046233:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046237:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046242:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046247:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046252:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046257:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046263:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046268:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046273:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046278:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046282:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046287:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046291:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046296:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046301:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046307:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046311:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046324:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046329:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046334:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046339:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046344:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046349:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046355:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.046361:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.047858:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e2c35cae600:8415] 1 exiting: rc = 0 00000100:00100000:3.0:1787430902.050295:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e2c35caf600:8416] 2 exiting: rc = 0 00000100:00100000:1.0:1787430902.050816:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e2c35d03600:8414] 0 exiting: rc = 1 00000100:00100000:0.0:1787430902.051134:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051142:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051149:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051155:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051161:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051167:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051173:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051178:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051184:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051190:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051195:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051211:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051218:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051224:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051230:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051237:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051243:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051251:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051259:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051266:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051272:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051278:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051283:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051288:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051295:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051302:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051308:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051326:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051333:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051338:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051344:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051350:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051356:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051362:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051368:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051392:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051400:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051407:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051414:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051419:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051480:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051487:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051492:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051498:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051509:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051516:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051580:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051587:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051594:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051687:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051695:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051702:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051708:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051713:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051719:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051725:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051731:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051736:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051742:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051748:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051766:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051775:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051787:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430902.051794:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064377:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e2c3a4c0400:8417] 0 exiting: rc = 1 00000100:00100000:1.0:1787430902.064583:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e2c3a4c0000:8418] 1 exiting: rc = 0 00000100:00100000:2.0:1787430902.064746:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064754:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064760:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064764:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064769:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064774:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064779:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064784:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064789:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064807:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064812:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064817:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064823:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064828:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064833:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064838:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064842:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064847:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064886:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064893:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064898:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064903:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064909:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064914:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064919:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064924:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064928:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064933:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064938:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064943:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064948:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064952:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064957:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064962:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064967:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064972:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064977:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064982:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064987:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064993:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.064998:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065236:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065244:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065249:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065262:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065267:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065272:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065277:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065282:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065287:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065293:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065299:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065305:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065311:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065316:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065322:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065328:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065333:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065340:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065345:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065350:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065356:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065361:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430902.065373:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.067871:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e2c36133200:8419] 0 exiting: rc = 1 00000100:00100000:2.0:1787430902.069679:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e2c36132800:8420] 1 exiting: rc = 0 00000100:00100000:1.0:1787430902.069856:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069864:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069876:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069883:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069888:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069894:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069899:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069920:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069927:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069932:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069937:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069943:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069949:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069954:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069960:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069966:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069971:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069976:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.069982:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070002:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070009:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070015:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070021:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070027:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070033:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070101:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070110:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070116:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070122:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070139:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070146:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070165:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070172:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070178:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070184:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070190:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070195:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070201:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070207:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070213:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070219:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070224:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070229:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070247:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070254:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070260:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070266:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070272:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070279:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070285:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070291:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070297:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070305:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070312:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070318:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070339:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070347:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070352:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070358:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070367:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070374:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070380:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070386:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430902.070400:0:15734:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787430902.084743:0:15734:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787430917.237030:0:16499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787430925.324492:0:17099:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787430925.324498:0:17099:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787430925.324500:0:17099:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787430925.325081:0:17099:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2c3a6a7800 00000020:01000004:0.0:1787430925.325097:0:17099:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787430925.325104:0:17099:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787430925.325117:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e2b03b9cd28) 00000020:00000080:0.0:1787430925.325129:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787430925.372654:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787430925.373124:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.375305:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.375739:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.375980:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.376179:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.376391:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.376860:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.377052:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.377243:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.377497:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.377805:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.377996:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.378187:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.378435:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.378769:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.378988:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.379199:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.379358:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.379588:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.379920:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.380104:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.380348:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.380569:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.380931:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.381115:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.381362:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.381546:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.381837:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.381999:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.382210:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.382402:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.382595:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787430925.382957:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787430925.384217:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787430925.384453:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787430925.384953:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787430925.385131:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.385288:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787430925.385463:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787430925.385724:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787430925.385975:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787430925.386168:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.386371:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.386566:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.386908:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.388238:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.389222:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.389619:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.389996:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.390364:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.390555:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787430925.390939:0:17099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1787430925.391414:0:17099:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787430925.391877:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787430925.391885:0:17099:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787430925.391898:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a95071 00000020:01000004:0.0:1787430925.391905:0:17099:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787430925.391910:0:17099:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787430925.391916:0:17099:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2c3a6a7800 from MGS 00000020:01000004:0.0:1787430925.391920:0:17099:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787430925.391929:0:17099:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e2b03b9b370) 00000020:00000080:0.0:1787430925.391940:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787430925.392003:0:17099:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c3a6a7800 from MGS, refs=2 00080000:01000000:0.0:1787430925.392007:0:17099:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787430925.392013:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a9507f 00000100:00100000:0.0:1787430925.392114:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787430925.392238:0:17099:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787430925.392242:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787430925.393036:0:17099:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787430925.393045:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787430925.394072:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430925.394350:0:17099:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787430925.394355:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787430925.395430:0:17099:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787430925.395439:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787430925.397048:0:17099:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787430925.397061:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787430925.398498:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430925.398502:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430925.398504:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430925.399378:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430925.399381:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430925.399383:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430925.404895:0:17099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787430925.406467:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787430925.408379:0:17099:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787430925.413736:0:17111:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787430925.413964:0:17099:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787430925.414013:0:17099:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430925.414588:0:17099:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787430925.415023:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430925.415219:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787430925.415224:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787430925.418633:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787430925.418647:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787430925.420209:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787430925.420222:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787430925.422003:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787430925.422025:0:17099:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.125@tcp' 00000020:01000004:2.0:1787430925.422027:0:17099:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787430925.422060:0:17099:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.125@tcp (typ=mgc) 00000020:00000080:2.0:1787430925.422074:0:17099:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.125@tcp (ffff8e2b0355cd28) 00000020:00000080:2.0:1787430925.422090:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787430925.422178:0:17099:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b04984800@MGC192.168.202.125@tcp: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430925.422340:0:17099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.125@tcp-0 is initialized 00000040:01000000:2.0:1787430925.422347:0:17099:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787430925.422456:0:17116:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787430925.423808:0:17117:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787430925.423905:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.125@tcp (uuid fee52dc1-c4f0-4b23-ab4e-898c85fea4e1) 00000020:00000080:3.0:1787430925.423926:0:17099:0:(genops.c:1385:class_connect()) connect: client fee52dc1-c4f0-4b23-ab4e-898c85fea4e1, cookie 0x4dbb683ba6a9508d 00000100:00080000:3.0:1787430925.423939:0:17099:0:(import.c:510:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430925.423945:0:17099:0:(import.c:624:import_select_connection()) MGC192.168.202.125@tcp: import ffff8e2b04984800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430925.423982:0:17099:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b18000 x1874256847848192/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430925.424054:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3626:1874256847848192:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787430925.424123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.424208:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847848192 00000100:00100000:2.0:1787430925.424215:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847848192 00000100:00100000:2.0:1787430925.424252:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430925.424259:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3626:x1874256847848192:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787430925.424281:0:17112:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fee52dc1-c4f0-4b23-ab4e-898c85fea4e1@0@lo t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1787430925.424301:0:17112:0:(genops.c:1385:class_connect()) connect: client fee52dc1-c4f0-4b23-ab4e-898c85fea4e1, cookie 0x4dbb683ba6a95094 00000100:00080000:2.0:1787430925.424425:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8e2b04981800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787430925.424505:0:17099:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fee52dc1-c4f0-4b23-ab4e-898c85fea4e1->MGS 00000020:01000004:3.0:1787430925.424523:0:17099:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787430925.424542:0:17099:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787430925.424554:0:17099:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e2b03628000) 00000020:00000080:3.0:1787430925.424564:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787430925.426888:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+5:3626:x1874256847848192:12345-0@lo:250:mount.lustre.0 Request processed in 2618us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430925.426903:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430925.429904:0:3626:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787430925.429926:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.125@tcp: connect to target with instance 0 00000100:00080000:0.0:1787430925.429935:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787430925.429941:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787430925.429945:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b04984800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787430925.429949:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787430925.429967:0:3626:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787430925.429976:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3626:1874256847848192:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787430925.436572:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430925.436850:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787430925.436854:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787430925.437807:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787430925.437815:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787430925.438181:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787430925.438188:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787430925.439045:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430925.439212:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787430925.439217:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787430925.439719:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787430925.439725:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787430925.472853:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430925.473072:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787430925.473079:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787430925.474589:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787430925.474889:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787430925.475991:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430925.476201:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787430925.476207:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787430925.476596:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787430925.476631:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787430925.477158:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430925.477293:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787430925.477298:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787430925.478026:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787430925.478043:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787430925.478874:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430925.479024:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787430925.479030:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787430925.480104:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787430925.480114:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787430925.494098:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430925.494291:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787430925.494296:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787430925.499707:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787430925.499724:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787430925.500863:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787430925.500874:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787430925.502068:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787430925.502101:0:17099:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787430925.502109:0:17099:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787430925.502393:0:17099:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787430925.502432:0:17099:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787430925.502437:0:17099:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787430925.502439:0:17099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787430925.502440:0:17099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430925.502442:0:17099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430925.502443:0:17099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430925.502444:0:17099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430925.502446:0:17099:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787430925.502452:0:17099:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787430925.502454:0:17099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430925.502455:0:17099:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787430925.502457:0:17099:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787430925.502459:0:17099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787430925.502461:0:17099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787430925.502461:0:17099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430925.502462:0:17099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430925.502463:0:17099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430925.502464:0:17099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430925.502465:0:17099:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787430925.502466:0:17099:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787430925.502467:0:17099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430925.502468:0:17099:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787430925.502503:0:17099:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787430925.502528:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787430925.502747:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.502843:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430925.502984:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847848320 00000100:00100000:0.0:1787430925.502992:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847848320 00000100:00100000:0.0:1787430925.503096:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430925.503108:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+5:17099:x1874256847848320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430925.503155:0:17115:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430925.503158:0:17115:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787430925.503162:0:17115:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787430925.503462:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787430925.504170:0:17115:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787430925.506082:0:17137:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787430925.506089:0:17137:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787430925.506100:0:17137:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787430925.506102:0:17137:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787430925.506405:0:17137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787430925.506751:0:17115:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430925.506763:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787430925.508417:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+5:17099:x1874256847848320:12345-0@lo:253:mount.lustre.0 Request processed in 5304us (5663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430925.508436:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787430925.508453:0:17099:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787430925.508456:0:17099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430925.508458:0:17099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787430925.508460:0:17099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430925.508461:0:17099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430925.508462:0:17099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430925.508464:0:17099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430925.508465:0:17099:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787430925.508466:0:17099:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787430925.508469:0:17099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430925.508470:0:17099:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787430925.508489:0:17099:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2c3a6a7800 from lustre-MDT0000 10000000:01000000:2.0:1787430925.508519:0:17099:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787430925.508522:0:17099:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787430925.508526:0:17099:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e2b0355cd28 10000000:01000000:2.0:1787430925.508530:0:17099:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430925.508538:0:17099:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e2b0355cd28 from 1 10000000:01000000:2.0:1787430925.508548:0:17099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787430925.508586:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.508596:0:17099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430925.508684:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787430925.508716:0:17099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430925.508737:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430925.508884:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.508921:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430925.508946:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847848448 00000100:00100000:1.0:1787430925.508953:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847848448 00000100:00100000:1.0:1787430925.508999:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430925.509008:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+5:17099:x1874256847848448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430925.509020:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430925.509039:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4a00/0x4dbb683ba6a950a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a950a2 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.509058:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4a00/0x4dbb683ba6a950a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a950a2 expref: 6 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.509066:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce4a00/0x4dbb683ba6a950a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a950a2 expref: 6 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.509072:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4a00, rc 0) 00000100:00100000:1.0:1787430925.509101:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+6:17099:x1874256847848448:12345-0@lo:101:mount.lustre.0 Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430925.509107:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787430925.509130:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430925.509143:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.509152:0:17099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430925.509259:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430925.509277:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.509292:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430925.509318:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847848576 00000100:00100000:0.0:1787430925.509322:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847848576 00000100:00100000:0.0:1787430925.509364:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430925.509371:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+6:17099:x1874256847848576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430925.509586:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430925.509587:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+6:17099:x1874256847848576:12345-0@lo:501:mount.lustre.0 Request processed in 216us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430925.509594:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:2.0:1787430925.509666:0:17099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787430925.509683:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.509702:0:17099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430925.509711:0:17099:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2c3a6a7800 10000000:01000000:2.0:1787430925.509715:0:17099:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787430925.509718:0:17099:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e2c3a6a7800 10000000:01000000:2.0:1787430925.509721:0:17099:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787430925.509724:0:17099:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e2c3a6a7800 from 1 10000000:01000000:2.0:1787430925.509726:0:17099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787430925.509806:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02c00/0x4dbb683ba6a950b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.509871:0:17099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02c00/0x4dbb683ba6a950b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.509878:0:17099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02c00/0x4dbb683ba6a950b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430925.509890:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430925.509915:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.509945:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430925.509994:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847848704 00000100:00100000:1.0:1787430925.509997:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847848704 00000100:00100000:1.0:1787430925.510047:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430925.510054:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+6:17099:x1874256847848704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430925.510061:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430925.510070:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4000/0x4dbb683ba6a950b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a950b0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.510085:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4000/0x4dbb683ba6a950b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a950b0 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.510093:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce4000/0x4dbb683ba6a950b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a950b0 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.510100:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4000, rc 0) 00000100:00100000:1.0:1787430925.510136:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+7:17099:x1874256847848704:12345-0@lo:101:mount.lustre.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430925.510142:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787430925.510207:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430925.510219:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02c00/0x4dbb683ba6a950b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950b7 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.510227:0:17099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02c00/0x4dbb683ba6a950b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a950b7 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430925.510248:0:17099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787430925.510263:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02c00/0x4dbb683ba6a950b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950b7 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.510270:0:17099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02c00/0x4dbb683ba6a950b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950b7 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430925.510276:0:17099:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787430925.510280:0:17099:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430925.510285:0:17099:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e2c3a6a7800 10000000:01000000:2.0:1787430925.510288:0:17099:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787430925.510291:0:17099:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787430925.510293:0:17099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787430925.510306:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02600/0x4dbb683ba6a950be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.510337:0:17099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02600/0x4dbb683ba6a950be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.510345:0:17099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02600/0x4dbb683ba6a950be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430925.510359:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430925.510383:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.510579:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.510642:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847848832 00000100:00100000:3.0:1787430925.510647:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847848832 00000100:00100000:3.0:1787430925.510672:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430925.510678:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+7:17099:x1874256847848832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430925.510684:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430925.510693:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b000/0x4dbb683ba6a950c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a950be expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.510706:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b000/0x4dbb683ba6a950c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a950be expref: 8 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.510714:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b000/0x4dbb683ba6a950c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a950be expref: 8 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.510720:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b000, rc 0) 00000100:00100000:3.0:1787430925.510758:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+8:17099:x1874256847848832:12345-0@lo:101:mount.lustre.0 Request processed in 81us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.510765:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787430925.510841:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430925.510852:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02600/0x4dbb683ba6a950be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950c5 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430925.510866:0:17099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02600/0x4dbb683ba6a950be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a950c5 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430925.510914:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430925.510939:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.510967:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.511075:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847848960 00000100:00100000:3.0:1787430925.511080:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847848960 00000100:00100000:3.0:1787430925.511098:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430925.511105:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+8:17099:x1874256847848960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430925.511243:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17099:x1874256847848960:12345-0@lo:501:mount.lustre.0 Request processed in 138us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.511250:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787430925.511440:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847848960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430925.511471:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847849088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430925.511514:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.511536:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.511690:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847849088 00000100:00100000:3.0:1787430925.511702:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847849088 00000100:00100000:3.0:1787430925.511723:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430925.511730:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17099:x1874256847849088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787430925.512659:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17099:x1874256847849088:12345-0@lo:503:mount.lustre.0 Request processed in 924us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.512669:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787430925.512777:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847849088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430925.513944:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17138:1874256847849216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430925.513990:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.514021:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.514030:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847849216 00000100:00100000:3.0:1787430925.514035:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847849216 00000100:00100000:3.0:1787430925.514067:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430925.514076:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17138:x1874256847849216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430925.514715:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17138:x1874256847849216:12345-0@lo:502:llog_process_th.0 Request processed in 637us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.514725:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787430925.514736:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17138:1874256847849216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787430925.514763:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430925.514775:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430925.514778:0:17138:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787430925.514783:0:17138:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787430925.514786:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430925.514873:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e2b03b999b8) 00000020:00000080:0.0:1787430925.514893:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787430925.514899:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787430925.514963:0:17138:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787430925.514967:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a950d3 00000020:00000080:0.0:1787430925.515311:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787430925.515317:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430925.515320:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430925.515322:0:17138:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787430925.515336:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430925.515340:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430925.515342:0:17138:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787430925.515345:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430925.515353:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e2b03b98000) 00000020:00000080:0.0:1787430925.515363:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787430925.515367:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787430925.515369:0:17138:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787430925.515372:0:17138:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787430925.515378:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787430925.515422:0:17138:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c3a6a7800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787430925.515445:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e2c35c50000) 00000020:00000080:0.0:1787430925.515455:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787430925.515496:0:17138:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787430925.515499:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a950e8 00000020:00000080:0.0:1787430925.515562:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787430925.515566:0:17138:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787430925.515568:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4dbb683ba6a950ef 00080000:01000000:0.0:1787430925.515572:0:17138:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787430925.515574:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a950f6 00010000:00010000:2.0:1787430925.612024:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787430925.612797:0:17138:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787430925.613237:0:17138:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787430925.615705:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e2b0355b370) 00000020:00000080:2.0:1787430925.615733:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787430925.615857:0:17138:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787430925.615864:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a95104 00000020:00000080:2.0:1787430925.618629:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787430925.624675:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4dbb683ba6a9510b 00000020:00000080:2.0:1787430925.628771:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787430925.628788:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430925.628881:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.628884:0:17138:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787430925.628889:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787430925.628892:0:17138:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787430925.628894:0:17138:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787430925.628895:0:17138:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787430925.628897:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787430925.628899:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.628901:0:17138:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787430925.628903:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430925.628909:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.628911:0:17138:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787430925.628916:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787430925.628970:0:17138:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787430925.628987:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430925.628990:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.628991:0:17138:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787430925.628994:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430925.628997:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.628998:0:17138:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787430925.629001:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787430925.629007:0:17138:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:2.0:1787430925.629034:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430925.629050:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e2b035599b8) 00000020:00000080:2.0:1787430925.629066:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787430925.629072:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787430925.629126:0:17138:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787430925.629132:0:17138:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787430925.629137:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a95119 00010000:00080000:2.0:1787430925.629171:0:17138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c042f7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430925.631097:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787430925.642180:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430925.642195:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787430925.642231:0:17138:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787430925.642252:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a95120 00000100:00080000:0.0:1787430925.642262:0:17138:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787430925.642269:0:17138:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2c042f7800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430925.642304:0:17138:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03ae2d80 x1874256847849344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787430925.642373:0:17138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787430925.642596:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430925.642630:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430925.642633:0:17138:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787430925.642637:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787430925.642640:0:17138:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787430925.642641:0:17138:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787430925.642643:0:17138:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787430925.642644:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787430925.642647:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430925.642648:0:17138:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787430925.642651:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787430925.642655:0:17138:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787430925.642659:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430925.642660:0:17138:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787430925.642664:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787430925.642678:0:17138:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:0.0:1787430925.642702:0:17138:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787430925.642705:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430925.642718:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e2c35c54d28) 00000020:00000080:0.0:1787430925.642729:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787430925.642735:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787430925.642924:0:17138:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787430925.642932:0:17138:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787430925.642938:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a9512e 00010000:00080000:0.0:1787430925.642971:0:17138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c3a676800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.125@tcp at head 00000100:00100000:1.0:1787430925.643136:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847849344:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787430925.643219:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430925.643667:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787430925.643907:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847849344 00000100:00100000:3.0:1787430925.643915:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847849344 00000100:00100000:3.0:1787430925.643944:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430925.643953:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847849344:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787430925.643953:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430925.643960:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847849472:0@lo:400:kworker.0 00010000:00020000:3.0:1787430925.643969:0:17125:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787430925.643992:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.644025:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847849472 00000100:00100000:1.0:1787430925.644028:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847849472 00000100:00100000:1.0:1787430925.644128:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430925.644136:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:3627:x1874256847849472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430925.644409:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:3627:x1874256847849472:12345-0@lo:400:kworker.0 Request processed in 273us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430925.644422:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430925.644526:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847849472:0@lo:400:kworker.0 00000040:01000000:0.0:1787430925.645957:0:17138:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787430925.654615:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787430925.666004:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430925.667392:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:2.0:1787430925.675472:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847849344:12345-0@lo:38:llog_process_th.0 Request processed in 31509us (32243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430925.675501:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787430925.675669:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787430925.675675:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787430925.675680:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847849344:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787430925.675810:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787430925.677250:0:17144:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787430925.677256:0:17144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787430925.681925:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787430925.681941:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787430925.681985:0:17138:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787430925.682005:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a95135 00000100:00080000:1.0:1787430925.682016:0:17138:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430925.682022:0:17138:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2c3a676800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430925.682141:0:17138:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac2d80 x1874256847849600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430925.682224:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847849600:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787430925.682283:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847849600 offset 0 length 520: 4 00000100:00080000:1.0:1787430925.682630:0:17138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787430925.682703:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430925.682708:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430925.682710:0:17138:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787430925.682714:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787430925.682716:0:17138:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787430925.682718:0:17138:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430925.682720:0:17138:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430925.682721:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787430925.682724:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430925.682726:0:17138:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787430925.682728:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787430925.682732:0:17138:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787430925.682736:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430925.682737:0:17138:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787430925.682748:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787430925.682753:0:17138:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1787430925.682774:0:17138:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787430925.682776:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787430925.682789:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e2c35de8000) 00000020:00000080:1.0:1787430925.682802:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787430925.682807:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787430925.682868:0:17138:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787430925.682873:0:17138:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787430925.682879:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4dbb683ba6a95143 00010000:00080000:1.0:1787430925.682906:0:17138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c31563000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1787430925.683228:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787430925.683290:0:17138:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787430925.683305:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787430925.689181:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430925.691478:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787430925.691679:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787430925.695217:0:17146:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787430925.695225:0:17146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787430925.695905:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787430925.695919:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787430925.696099:0:17138:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787430925.696121:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a9514a 00000100:00080000:1.0:1787430925.696133:0:17138:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430925.696139:0:17138:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2c31563000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430925.696244:0:17138:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03d89180 x1874256847849728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430925.696267:0:17138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787430925.696341:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430925.696346:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.696348:0:17138:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787430925.696352:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430925.696356:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.696357:0:17138:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787430925.696361:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787430925.696362:0:17138:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787430925.696364:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430925.696366:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.696367:0:17138:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787430925.696369:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430925.696371:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.696373:0:17138:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787430925.696377:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787430925.696410:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17138:1874256847849856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430925.696506:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.696543:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02aeecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.696694:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847849856 00000100:00100000:3.0:1787430925.696701:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847849856 00000100:00100000:3.0:1787430925.696751:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430925.696762:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17138:x1874256847849856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430925.696877:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17138:x1874256847849856:12345-0@lo:502:llog_process_th.0 Request processed in 117us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.696894:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787430925.696984:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17138:1874256847849856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430925.697009:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430925.697013:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430925.697015:0:17138:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787430925.697019:0:17138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787430925.697181:0:17099:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787430925.697201:0:17099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787430925.697223:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02600/0x4dbb683ba6a950be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950c5 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.697235:0:17099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02600/0x4dbb683ba6a950be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950c5 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430925.697245:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847849728:0@lo:8:llog_process_th.0 10000000:01000000:1.0:1787430925.697253:0:17099:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a7800 from 1 10000000:01000000:1.0:1787430925.697256:0:17099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000400:00000100:0.0:1787430925.697275:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847849728 offset 0 length 520: 4 00010000:00010000:1.0:1787430925.697283:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.697292:0:17099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.697300:0:17099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430925.697314:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847849984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787430925.697354:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.697378:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12bbb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430925.697412:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847849984 00000100:00100000:0.0:1787430925.697417:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847849984 00000100:00100000:0.0:1787430925.697449:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430925.697457:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+9:17099:x1874256847849984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430925.697466:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430925.697479:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95151 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.697510:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.697520:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.697528:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175a00, rc 0) 00000100:00100000:0.0:1787430925.697562:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+10:17099:x1874256847849984:12345-0@lo:101:mount.lustre.0 Request processed in 105us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430925.697568:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430925.697633:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847849984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430925.697646:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.697655:0:17099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430925.698540:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850112:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787430925.698580:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.698796:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847850112 00000100:00100000:1.0:1787430925.698802:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847850112 00000100:00100000:1.0:1787430925.698857:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787430925.698866:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+10:17099:x1874256847850112:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787430925.698881:0:17112:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787430925.698887:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787430925.699155:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173600 going to sleep for 11 seconds 00000100:00100000:1.0:1787430925.699161:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+10:17099:x1874256847850112:12345-0@lo:256:mount.lustre.0 Request processed in 297us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430925.699168:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430925.699169:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850112:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787430925.699762:0:17099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787430925.699778:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.699789:0:17099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430925.699797:0:17099:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a7800 from 1 10000000:01000000:0.0:1787430925.699799:0:17099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430925.699824:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.699831:0:17099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.699846:0:17099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430925.699863:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430925.699893:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430925.700045:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02173600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.706855:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847850240 00000100:00100000:3.0:1787430925.706872:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847850240 00000100:00100000:3.0:1787430925.706949:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787430925.706961:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+10:17099:x1874256847850240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430925.706977:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430925.706998:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9515f expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.707026:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 11 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.707038:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 11 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.707048:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8bc00, rc 0) 00000100:00100000:3.0:1787430925.710140:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17099:x1874256847850240:12345-0@lo:101:mount.lustre.0 Request processed in 3172us (10235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.710153:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787430925.712205:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430925.712244:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.712258:0:17099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430925.712452:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430925.712519:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.712563:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12bbb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430925.713556:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847850368 00000100:00100000:0.0:1787430925.713565:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847850368 00000100:00100000:0.0:1787430925.713635:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430925.713642:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17099:x1874256847850368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430925.713813:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17099:x1874256847850368:12345-0@lo:501:mount.lustre.0 Request processed in 170us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430925.713821:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430925.714035:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430925.714077:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430925.714124:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.714152:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12bbb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.714199:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847850496 00000100:00100000:3.0:1787430925.714203:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847850496 00000100:00100000:3.0:1787430925.714229:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787430925.714235:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17099:x1874256847850496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787430925.714320:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17099:x1874256847850496:12345-0@lo:503:mount.lustre.0 Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.714337:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430925.714415:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787430925.714936:0:17148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17148:1874256847850624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430925.714982:0:17148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430925.715013:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787430925.715064:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847850624 00000100:00100000:2.0:1787430925.715070:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847850624 00000100:00100000:2.0:1787430925.715108:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430925.715116:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17148:x1874256847850624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430925.716016:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17148:x1874256847850624:12345-0@lo:502:llog_process_th.0 Request processed in 899us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430925.716024:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787430925.717090:0:17148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17148:1874256847850624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430925.717131:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430925.717141:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.717142:0:17148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787430925.717148:0:17148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c3a6a7800 00000020:00000080:3.0:1787430925.717150:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430925.717156:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430925.717157:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.717158:0:17148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787430925.717160:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430925.717161:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.717162:0:17148:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787430925.717164:0:17148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c3a6a7800 00000020:00000080:3.0:1787430925.717165:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430925.717254:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430925.717257:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.717257:0:17148:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787430925.717259:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430925.717260:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.717261:0:17148:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430925.717263:0:17148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c3a6a7800 00000020:00000080:3.0:1787430925.717264:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430925.718550:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430925.718557:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.718558:0:17148:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430925.718561:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430925.718563:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.718564:0:17148:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787430925.718567:0:17148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c3a6a7800 00000020:00000080:3.0:1787430925.718568:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787430925.718716:0:17148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17148:1874256847850752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430925.718785:0:17148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430925.720923:0:17148:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787430925.721239:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847850752 00000100:00100000:2.0:1787430925.721250:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847850752 00000100:00100000:2.0:1787430925.722543:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430925.722555:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17148:x1874256847850752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430925.722720:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17148:x1874256847850752:12345-0@lo:502:llog_process_th.0 Request processed in 167us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430925.722728:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430925.723241:0:17148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17148:1874256847850752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430925.723274:0:17148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430925.723283:0:17148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430925.723285:0:17148:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787430925.723290:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787430925.725554:0:17099:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787430925.725594:0:17099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430925.725640:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.725655:0:17099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430925.725707:0:17099:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787430925.725710:0:17099:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2c3a6a7800 10000000:01000000:0.0:1787430925.725714:0:17099:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2c3a6a7800 10000000:01000000:0.0:1787430925.725718:0:17099:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430925.725723:0:17099:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c3a6a7800 from 1 10000000:01000000:0.0:1787430925.725726:0:17099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430925.725765:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a9516d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.725773:0:17099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a9516d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.725785:0:17099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a9516d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430925.725947:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430925.726014:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430925.728695:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12966540 going to sleep for 11 seconds 00000100:00100000:3.0:1787430925.729564:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847850880 00000100:00100000:3.0:1787430925.729575:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847850880 00000100:00100000:3.0:1787430925.730585:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787430925.730599:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17099:x1874256847850880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430925.730635:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430925.730654:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b200/0x4dbb683ba6a95174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9516d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.730682:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b200/0x4dbb683ba6a95174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9516d expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.730694:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b200/0x4dbb683ba6a95174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9516d expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.730704:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b200, rc 0) 00000100:00100000:3.0:1787430925.730770:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17099:x1874256847850880:12345-0@lo:101:mount.lustre.0 Request processed in 175us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.730777:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430925.731869:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847850880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430925.731892:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a9516d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95174 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.731903:0:17099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a9516d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95174 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430925.731980:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847851008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430925.732020:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430925.732058:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12966540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430925.732227:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851008 00000100:00100000:2.0:1787430925.732234:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851008 00000100:00100000:2.0:1787430925.732278:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430925.732287:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17099:x1874256847851008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430925.732412:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17099:x1874256847851008:12345-0@lo:501:mount.lustre.0 Request processed in 126us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430925.732420:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430925.732651:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847851008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430925.732680:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847851136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430925.732715:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430925.732736:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12966540 going to sleep for 11 seconds 00000100:00100000:2.0:1787430925.732883:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851136 00000100:00100000:2.0:1787430925.732888:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851136 00000100:00100000:2.0:1787430925.732917:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430925.732924:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17099:x1874256847851136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430925.732991:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17099:x1874256847851136:12345-0@lo:503:mount.lustre.0 Request processed in 68us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430925.733002:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787430925.733075:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847851136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430925.733277:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17153:1874256847851264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430925.733310:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430925.733337:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c129666c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430925.733384:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851264 00000100:00100000:2.0:1787430925.733388:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851264 00000100:00100000:2.0:1787430925.733416:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787430925.733581:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17153:x1874256847851264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430925.733693:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17153:x1874256847851264:12345-0@lo:502:llog_process_th.0 Request processed in 270us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430925.733701:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787430925.733887:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17153:1874256847851264:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787430925.733932:0:17153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787430925.733944:0:17153:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e2c35c53370) 00000020:00000080:0.0:1787430925.733959:0:17153:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787430925.734018:0:17153:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c3a6a7800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787430925.734021:0:17153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c3a6a7800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787430925.734022:0:17153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c3a6a7800 4 00010000:00080000:0.0:1787430925.734097:0:17153:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c363ad000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1787430925.737531:0:17153:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787430925.737991:0:17153:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787430925.738100:0:17153:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787430925.738113:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4dbb683ba6a95182 00000100:00080000:0.0:1787430925.738124:0:17153:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787430925.738129:0:17153:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e2c363ad000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1787430925.738172:0:17153:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03ae1f80 x1874256847851392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430925.738207:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847851392:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787430925.738274:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430925.738451:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851392 00000100:00100000:2.0:1787430925.738459:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851392 00000100:00080000:0.0:1787430925.738477:0:17153:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787430925.738490:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430925.738498:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847851392:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787430925.738553:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847851392:12345-0@lo:38:llog_process_th.0 Request processed in 54us (278us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787430925.738560:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430925.739796:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787430925.739808:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c363ad000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430925.739814:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787430925.739818:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847851392:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787430925.739988:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17153:1874256847851520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430925.740045:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.740076:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851520 00000100:00100000:1.0:1787430925.740081:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851520 00000100:00100000:1.0:1787430925.740119:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430925.740127:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17153:x1874256847851520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430925.740232:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17153:x1874256847851520:12345-0@lo:502:llog_process_th.0 Request processed in 106us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430925.740244:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430925.740287:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430925.740299:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17153:1874256847851520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430925.740343:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17153:1874256847851648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430925.740372:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.740393:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851648 00000100:00100000:1.0:1787430925.740396:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851648 00000100:00100000:1.0:1787430925.740417:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430925.741217:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430925.743987:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17153:x1874256847851648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430925.744170:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17153:x1874256847851648:12345-0@lo:502:llog_process_th.0 Request processed in 3744us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430925.744180:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430925.744210:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17153:1874256847851648:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787430925.744244:0:17153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787430925.744363:0:17099:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787430925.744386:0:17099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430925.744408:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a9516d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95174 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.744419:0:17099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42174600/0x4dbb683ba6a9516d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95174 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787430925.744465:0:17099:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787430925.744467:0:17099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787430925.744468:0:17099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430925.744470:0:17099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430925.744471:0:17099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430925.744473:0:17099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430925.744475:0:17099:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430925.744476:0:17099:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787430925.744483:0:17099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430925.744484:0:17099:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430925.744488:0:17099:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787430925.744490:0:17099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430925.744491:0:17099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787430925.744492:0:17099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430925.744493:0:17099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430925.744494:0:17099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430925.744494:0:17099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430925.744495:0:17099:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430925.744496:0:17099:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787430925.744497:0:17099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430925.744498:0:17099:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430925.744516:0:17099:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787430925.744532:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847851776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787430925.744566:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.744592:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35c8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430925.744627:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851776 00000100:00100000:1.0:1787430925.744634:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851776 00000100:00100000:1.0:1787430925.744671:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430925.744678:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17099:x1874256847851776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787430925.744698:0:17112:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787430925.744711:0:17112:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787430925.747904:0:17112:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787430925.747926:0:17112:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787430925.748011:0:17136:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787430925.748015:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787430925.748035:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.748054:0:17136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.748062:0:17136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.748108:0:17136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430925.748119:0:17136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 12 pid: 17115 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430925.748130:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847851904:0@lo:104: 00000100:00100000:1.0:1787430925.748184:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430925.748223:0:17136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c0416e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430925.748242:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847851904 00000100:00100000:0.0:1787430925.748249:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847851904 00000100:00100000:0.0:1787430925.748300:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430925.748388:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847851904:12345-0@lo:104: 00010000:00010000:0.0:1787430925.748401:0:17103:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430925.748439:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17099:x1874256847851776:12345-0@lo:253:mount.lustre.0 Request processed in 3760us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430925.748455:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787430925.748526:0:17103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430925.748532:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847851904:12345-0@lo:104: Request processed in 224us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430925.748539:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787430925.748555:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430925.748561:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748568:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430925.748572:0:17109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748580:0:17109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430925.748587:0:17109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430925.748588:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847851904:0@lo:104: 10000000:01000000:0.0:1787430925.748593:0:17109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430925.748639:0:17109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748645:0:17109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430925.748671:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748678:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a95151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95158 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748692:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430925.748694:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430925.748696:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430925.748725:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847852032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430925.748754:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430925.748822:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852032 00000100:00100000:0.0:1787430925.748827:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852032 00010000:00010000:0.0:1787430925.748843:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 12 pid: 17115 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430925.748875:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430925.748885:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:3629:x1874256847852032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430925.748895:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430925.748900:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 12 pid: 17115 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748911:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 12 pid: 17115 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748924:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42175a00/0x4dbb683ba6a95158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a95151 expref: 12 pid: 17115 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748938:0:17105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748955:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430925.748969:0:17105:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000953868s 00010000:00010000:0.0:1787430925.748973:0:17105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748980:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748988:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.748995:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.749001:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430925.749006:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.749013:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.749022:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430925.749043:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430925.749075:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:3629:x1874256847852032:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430925.749083:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430925.749129:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847852032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430925.752598:0:17136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.752631:0:17136:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.752638:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430925.752645:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a95189 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430925.752903:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17099:1874256847851776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787430925.752919:0:17099:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787430925.752923:0:17099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430925.752924:0:17099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787430925.752926:0:17099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430925.752927:0:17099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430925.752928:0:17099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430925.752930:0:17099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430925.752931:0:17099:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430925.752933:0:17099:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787430925.752934:0:17099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430925.752936:0:17099:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787430925.752950:0:17099:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1787430925.772890:0:17099:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787430925.774656:0:17099:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787430925.774678:0:17159:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787430925.774682:0:17159:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787430925.775142:0:17160:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787430925.775159:0:17099:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787430925.775555:0:17160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787430925.776232:0:17161:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8e2b04ac2300 x1874256847852160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430925.776246:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000040:01000000:0.0:1787430925.776485:0:17099:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787430925.776515:0:17099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430925.778124:0:17160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787430925.778212:0:17160:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1787430925.779070:0:17099:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787430925.779759:0:17099:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787430925.779879:0:17099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430925.780960:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787430925.785473:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787430925.785557:0:17099:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787430925.790884:0:17099:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1787430925.796567:0:17099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787430925.805227:0:17099:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787430925.805274:0:17099:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9cc9415d7988 00100000:10000000:0.0:1787430925.805282:0:17099:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787430925.806022:0:17099:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787430925.806040:0:17099:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787430925.806057:0:17099:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787430925.806076:0:17099:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787430925.806918:0:17099:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430925.807133:0:17099:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787430926.465525:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430926.787438:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000040:00080000:0.0:1787430926.803895:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787430926.976808:0:17117:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787430926.976815:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a7800 from 7 10000000:01000000:0.0:1787430926.976820:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787430926.976863:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430926.976874:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430926.976884:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430926.976921:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847852288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430926.976988:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430926.977036:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12a7c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430926.978167:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852288 00000100:00100000:1.0:1787430926.978179:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852288 00000100:00100000:1.0:1787430926.978242:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787430926.978252:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+11:17117:x1874256847852288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430926.978279:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430926.978306:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95190 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430926.978341:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430926.978351:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430926.978359:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5800, rc 0) 00000100:00100000:1.0:1787430926.978412:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17117:x1874256847852288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430926.978419:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430926.978943:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847852288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430926.978969:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430926.978980:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430926.979039:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847852416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787430926.979080:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430926.979117:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c12a7c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430926.979550:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852416 00000100:00100000:1.0:1787430926.979556:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852416 00000100:00100000:1.0:1787430926.979592:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787430926.979625:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17117:x1874256847852416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787430926.979640:0:17112:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430926.979656:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430926.979659:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787430926.979728:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17117:x1874256847852416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430926.979843:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787430926.979960:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847852416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787430926.980004:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787430926.980012:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430926.980021:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430927.493830:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430927.809493:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787430927.813548:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00010000:00010000:1.0:1787430928.520380:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430928.835463:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000001:02000400:2.0:1787430929.167415:0:17403:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787430929.538109:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787430929.824511:0:17455:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430929.824735:0:17455:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787430929.865697:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000020:00000004:2.0:1787430930.511934:0:17505:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430930.512149:0:17505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787430930.559830:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430930.894620:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000100:00080000:3.0:1787430931.201269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787430931.201284:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787430931.201288:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430931.201297:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 387 00000100:00080000:3.0:1787430931.201303:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787430931.201311:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2c042f7800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430931.201333:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b19180 x1874256847852672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430931.201370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430931.201374:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430931.201377:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430931.201380:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430931.201383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787430931.201386:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787430931.201388:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e2c363ad000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430931.201394:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e2c363ad000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430931.201407:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b19880 x1874256847852800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787430931.201430:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430931.201445:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847852544:0@lo:400:kworker.0 00000100:00100000:3.0:1787430931.201509:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430931.201584:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852544 00000100:00100000:3.0:1787430931.201591:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852544 00000100:00100000:3.0:1787430931.201662:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430931.201683:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:3629:x1874256847852544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430931.202011:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:3629:x1874256847852544:12345-0@lo:400:kworker.0 Request processed in 329us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430931.202020:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430931.202068:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847852544:0@lo:400:kworker.0 00000100:00100000:0.0:1787430931.202898:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847852672:0@lo:38:kworker.0 00000100:00100000:0.0:1787430931.203017:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430931.203056:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847852800:0@lo:38:kworker.0 00000100:00100000:0.0:1787430931.203084:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430931.203130:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852672 00000100:00100000:0.0:1787430931.203136:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852672 00000100:00100000:0.0:1787430931.203169:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430931.203176:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1874256847852672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787430931.203195:0:17126:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787430931.204846:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852800 00000100:00100000:1.0:1787430931.204858:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852800 00000100:00100000:1.0:1787430931.204894:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430931.204901:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847852800:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787430931.204924:0:17122:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:1.0:1787430931.204958:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4dbb683ba6a9519e 00000004:00100000:1.0:1787430931.204975:0:17122:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787430931.205104:0:17122:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a4bf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430931.205176:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874256847852800:12345-0@lo:38:kworker.0 Request processed in 274us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430931.205184:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787430931.208731:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2b03b19880 x1874256847852800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787430931.208755:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787430931.208764:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787430931.208770:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787430931.208773:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c363ad000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787430931.208781:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874256847852800:0@lo:38:kworker.0 00000100:00100000:3.0:1787430931.232311:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1874256847852672:12345-0@lo:38:kworker.0 Request processed in 29123us (29284us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787430931.232345:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787430931.232466:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787430931.232473:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787430931.232477:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847852672:0@lo:38:kworker.0 00010000:00010000:3.0:1787430931.583848:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430931.905208:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00010000:00010000:2.0:1787430932.609326:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430932.930735:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00010000:00010000:2.0:1787430933.631897:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430933.952290:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00010000:00010000:2.0:1787430934.655826:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430934.976721:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000100:00100000:2.0:1787430935.295857:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430925/real 1787430925] req@ffff8e2b03d89180 x1874256847849728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430935 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430935.295897:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b03d89180 x1874256847849728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430935 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430935.295909:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430925/real 1787430925] req@ffff8e2b04ac2d80 x1874256847849600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430935 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430935.295921:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b04ac2d80 x1874256847849600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430935 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430935.295938:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430935.296041:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430935.296048:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847849728:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787430935.296055:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a676800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787430935.296207:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787430935.296212:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787430935.296245:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430935.296251:0:9961:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 392 00000100:00080000:1.0:1787430935.296256:0:9961:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787430935.296263:0:9961:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2c042f7800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430935.296283:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac3b80 x1874256847853056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430935.296293:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430935.296296:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787430935.296297:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a676800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430935.296300:0:9961:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 387 00000100:00080000:1.0:1787430935.296302:0:9961:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787430935.296305:0:9961:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2c3a676800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430935.296315:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac0700 x1874256847853184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430935.296332:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430935.296335:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787430935.296336:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430935.296339:0:9961:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 387 00000100:00080000:1.0:1787430935.296341:0:9961:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787430935.296344:0:9961:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2c31563000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430935.296354:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac2680 x1874256847853312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787430935.296502:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847852928:0@lo:400:kworker.0 00000100:00100000:3.0:1787430935.296568:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430935.296730:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430935.296737:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847853440:0@lo:400:kworker.0 00000100:00100000:3.0:1787430935.296771:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430935.296828:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847853440 00000100:00100000:3.0:1787430935.296836:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847853440 00000100:00100000:3.0:1787430935.296887:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430935.296898:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847853440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430935.297080:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847853440:12345-0@lo:400:kworker.0 Request processed in 182us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.297088:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787430935.297168:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430935.297173:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847849600:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787430935.297199:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847853056:0@lo:38:kworker.0 00000100:00100000:2.0:1787430935.297248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430935.297270:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847853184:0@lo:8:kworker.0 00000400:00000100:2.0:1787430935.297307:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847853184 offset 0 length 520: 4 00000100:00100000:2.0:1787430935.297328:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847853312:0@lo:8:kworker.0 00000400:00000100:2.0:1787430935.297347:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847853312 offset 0 length 520: 4 00000100:00100000:2.0:1787430935.297374:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847853056 00000100:00100000:2.0:1787430935.297379:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847853056 00000100:00100000:1.0:1787430935.298587:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852928 00000100:00100000:1.0:1787430935.298596:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852928 00000100:00100000:0.0:1787430935.299224:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430935.299242:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:3627:x1874256847852928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430935.299321:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:3627:x1874256847852928:12345-0@lo:400:kworker.0 Request processed in 89us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.299329:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787430935.299368:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2b04ac0000 x1874256847853440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430935.299388:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847853440:0@lo:400:kworker.0 00000100:00100000:0.0:1787430935.299767:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847852928:0@lo:400:kworker.0 00000100:00100000:2.0:1787430935.301873:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787430935.301885:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847853056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787430935.302057:0:17125:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787430935.333624:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847853056:12345-0@lo:38:kworker.0 Request processed in 31705us (36351us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787430935.333649:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787430935.338269:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787430935.338283:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787430935.338289:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847853056:0@lo:38:kworker.0 00000020:01000004:0.0:1787430935.523862:0:17850:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787430935.523867:0:17850:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787430935.523868:0:17850:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787430935.524247:0:17850:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2c08afe800 00000020:01000004:0.0:1787430935.524264:0:17850:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787430935.524284:0:17850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787430935.524298:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8e2c35c519b8) 00000020:00000080:0.0:1787430935.524315:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787430935.577088:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.579755:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787430935.581329:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.581579:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.582019:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.582339:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.582638:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.583229:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.583962:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.584279:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.584515:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.584793:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.585021:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.585330:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.585528:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.585942:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.586159:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.586459:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.586761:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.587054:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.587365:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.587570:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.588105:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.588401:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.588648:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.588975:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.589183:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.589499:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.589879:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.590139:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.590456:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.590753:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.591007:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787430935.591285:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787430935.592768:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787430935.593103:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787430935.593756:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787430935.594307:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787430935.594643:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787430935.594951:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787430935.595281:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787430935.595493:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787430935.595798:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787430935.596091:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787430935.596406:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787430935.596838:0:17850:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1787430935.598286:0:17850:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787430935.598500:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787430935.598511:0:17850:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787430935.598526:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a951ac 00000020:01000004:2.0:1787430935.598533:0:17850:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787430935.598556:0:17850:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787430935.598559:0:17850:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787430935.598566:0:17850:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787430935.598596:0:17850:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787430935.598649:0:17850:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787430935.603486:0:17850:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787430935.603537:0:17850:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787430935.603542:0:17850:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787430935.603544:0:17850:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787430935.603545:0:17850:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430935.603546:0:17850:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430935.603547:0:17850:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430935.603549:0:17850:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430935.603550:0:17850:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430935.603552:0:17850:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430935.603553:0:17850:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787430935.603557:0:17850:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787430935.603559:0:17850:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430935.603561:0:17850:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787430935.603562:0:17850:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430935.603563:0:17850:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430935.603564:0:17850:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430935.603565:0:17850:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430935.603566:0:17850:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430935.603567:0:17850:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430935.603568:0:17850:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787430935.603595:0:17850:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787430935.603843:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787430935.603919:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.603975:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.604056:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847853568 00000100:00100000:3.0:1787430935.604065:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847853568 00000100:00100000:3.0:1787430935.604176:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787430935.604186:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17850:x1874256847853568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787430935.604219:0:17112:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787430935.604223:0:17112:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787430935.604229:0:17112:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787430935.604693:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17850:x1874256847853568:12345-0@lo:253:mount.lustre.0 Request processed in 507us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.604714:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430935.604875:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787430935.604886:0:17850:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787430935.604888:0:17850:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430935.604890:0:17850:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787430935.604891:0:17850:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430935.604892:0:17850:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430935.604893:0:17850:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430935.604895:0:17850:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430935.604896:0:17850:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430935.604898:0:17850:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430935.604899:0:17850:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787430935.604916:0:17850:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2c08afe800 from lustre-MDT0001 10000000:01000000:1.0:1787430935.604945:0:17850:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787430935.604954:0:17850:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787430935.604961:0:17850:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e2b0355cd28 local copy 00010000:00010000:1.0:1787430935.604972:0:17850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.605052:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430935.605079:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.605381:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430935.605462:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847853696 00000100:00100000:0.0:1787430935.605474:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847853696 00000100:00100000:0.0:1787430935.605510:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787430935.605517:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17850:x1874256847853696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430935.606009:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17850:x1874256847853696:12345-0@lo:501:mount.lustre.0 Request processed in 491us (927us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430935.606017:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787430935.606079:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853696:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787430935.606093:0:17850:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787430935.606111:0:17850:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787430935.606118:0:17850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.606193:0:17850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.606218:0:17850:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2c08afe800 10000000:01000000:1.0:1787430935.606222:0:17850:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787430935.606227:0:17850:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e2b0355cd28 10000000:01000000:1.0:1787430935.606229:0:17850:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787430935.606243:0:17850:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e2b0355cd28 from 1 10000000:01000000:1.0:1787430935.606246:0:17850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787430935.606270:0:17850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5c00/0x4dbb683ba6a951b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.606278:0:17850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5c00/0x4dbb683ba6a951b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.606299:0:17850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5c00/0x4dbb683ba6a951b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.606315:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787430935.606344:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.606363:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.606426:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847853824 00000100:00100000:3.0:1787430935.606431:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847853824 00000100:00100000:3.0:1787430935.606462:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787430935.606470:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+12:17850:x1874256847853824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430935.606478:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430935.606491:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a951ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a951b3 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.606510:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a951ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a951b3 expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.606520:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b800/0x4dbb683ba6a951ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a951b3 expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.606528:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b800, rc 0) 00000100:00100000:3.0:1787430935.606562:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+13:17850:x1874256847853824:12345-0@lo:101:mount.lustre.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.606568:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787430935.606803:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430935.606815:0:17850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5c00/0x4dbb683ba6a951b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951ba expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.606824:0:17850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5c00/0x4dbb683ba6a951b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a951ba expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.606839:0:17850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787430935.606845:0:17850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5c00/0x4dbb683ba6a951b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951ba expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.606852:0:17850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5c00/0x4dbb683ba6a951b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951ba expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.606858:0:17850:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e2c08afe800 10000000:01000000:1.0:1787430935.606862:0:17850:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787430935.606865:0:17850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e2c08afe800 from 1 10000000:01000000:1.0:1787430935.606867:0:17850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787430935.606880:0:17850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5000/0x4dbb683ba6a951c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.606887:0:17850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5000/0x4dbb683ba6a951c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.606908:0:17850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5000/0x4dbb683ba6a951c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.606920:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787430935.606946:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.606972:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.607067:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847853952 00000100:00100000:3.0:1787430935.607072:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847853952 00000100:00100000:3.0:1787430935.607101:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787430935.607109:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+13:17850:x1874256847853952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430935.607116:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430935.607124:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a600/0x4dbb683ba6a951c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a951c1 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.607264:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a600/0x4dbb683ba6a951c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a951c1 expref: 14 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.607281:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a600/0x4dbb683ba6a951c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a951c1 expref: 14 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.607287:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a600, rc 0) 00000100:00100000:3.0:1787430935.607324:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+14:17850:x1874256847853952:12345-0@lo:101:mount.lustre.0 Request processed in 217us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.607331:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430935.607398:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847853952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430935.607408:0:17850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5000/0x4dbb683ba6a951c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951c8 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.607415:0:17850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5000/0x4dbb683ba6a951c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a951c8 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.607426:0:17850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787430935.607439:0:17850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5000/0x4dbb683ba6a951c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951c8 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.607445:0:17850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5000/0x4dbb683ba6a951c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951c8 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.607451:0:17850:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787430935.607454:0:17850:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787430935.607459:0:17850:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e2c08afe800 10000000:01000000:1.0:1787430935.607462:0:17850:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787430935.607465:0:17850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787430935.607467:0:17850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787430935.607480:0:17850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4e00/0x4dbb683ba6a951cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.607493:0:17850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4e00/0x4dbb683ba6a951cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.607501:0:17850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4e00/0x4dbb683ba6a951cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.607513:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787430935.607539:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.607563:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.607781:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854080 00000100:00100000:3.0:1787430935.607786:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854080 00000100:00100000:3.0:1787430935.607814:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430935.607822:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+14:17850:x1874256847854080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430935.607829:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430935.607837:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a951d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a951cf expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.607850:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a951d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a951cf expref: 15 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.607859:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8a200/0x4dbb683ba6a951d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a951cf expref: 15 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.607865:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a200, rc 0) 00000100:00100000:3.0:1787430935.607908:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854080:12345-0@lo:101:mount.lustre.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.607914:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430935.607988:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430935.608000:0:17850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4e00/0x4dbb683ba6a951cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951d6 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430935.608009:0:17850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4e00/0x4dbb683ba6a951cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a951d6 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430935.609355:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1787430935.609996:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430935.616509:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787430935.616568:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787430935.616584:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787430935.616962:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787430935.616990:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1787430935.617007:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1787430935.617019:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1787430935.617030:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787430935.617041:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787430935.617054:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1787430935.617066:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1787430935.617080:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1787430935.617091:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1787430935.617104:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787430935.617116:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787430935.617155:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1787430935.617168:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787430935.617181:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787430935.617193:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1787430935.617204:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787430935.617217:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787430935.617231:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787430935.617259:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787430935.617287:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1787430935.617293:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1787430935.617397:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430935.617465:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.617517:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430935.617665:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854208 00000100:00100000:1.0:1787430935.617673:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854208 00000100:00100000:1.0:1787430935.617721:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787430935.617731:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430935.617881:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854208:12345-0@lo:501:mount.lustre.0 Request processed in 150us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.617889:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430935.618045:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430935.618078:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430935.618123:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430935.618220:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03f5db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430935.618301:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854336 00000100:00100000:0.0:1787430935.618306:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854336 00000100:00100000:0.0:1787430935.618340:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787430935.618348:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430935.618957:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854336:12345-0@lo:503:mount.lustre.0 Request processed in 607us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.618964:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787430935.619018:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787430935.619577:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430935.619910:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430935.619961:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.619998:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89000 going to sleep for 11 seconds 00000100:00100000:1.0:1787430935.620050:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854464 00000100:00100000:1.0:1787430935.620056:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854464 00000100:00100000:1.0:1787430935.620093:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430935.620101:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430935.621019:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854464:12345-0@lo:502:mount.lustre.0 Request processed in 914us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.621029:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787430935.621206:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430935.621420:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787430935.621458:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1787430935.621474:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1787430935.621487:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1787430935.621499:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1787430935.621512:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1787430935.621525:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1787430935.621538:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1787430935.621551:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1787430935.621565:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1787430935.621578:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1787430935.621593:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1787430935.621846:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1787430935.621862:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1787430935.621874:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1787430935.621885:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1787430935.621897:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1787430935.621909:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1787430935.621922:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1787430935.621935:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1787430935.621948:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1787430935.621961:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1787430935.621972:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1787430935.621986:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1787430935.621999:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1787430935.622012:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1787430935.622026:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1787430935.622041:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1787430935.622055:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1787430935.622067:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1787430935.622078:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1787430935.622088:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1787430935.622101:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1787430935.622114:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1787430935.622320:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1787430935.622340:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1787430935.622355:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1787430935.622371:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1787430935.622385:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1787430935.622399:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1787430935.622413:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1787430935.622427:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1787430935.622441:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1787430935.622453:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1787430935.622487:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430935.622548:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.622691:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89000 going to sleep for 11 seconds 00000100:00100000:2.0:1787430935.622941:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854592 00000100:00100000:2.0:1787430935.622948:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854592 00000100:00100000:3.0:1787430935.623102:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787430935.623114:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430935.623336:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847854592:12345-0@lo:502:mount.lustre.0 Request processed in 225us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.623345:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787430935.623423:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847854592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430935.623476:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1787430935.623486:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787430935.624352:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430935.624364:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430935.624366:0:17854:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787430935.624372:0:17854:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787430935.624375:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430935.624399:0:17854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8e2c3bd43370) 00000020:00000080:0.0:1787430935.624419:0:17854:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787430935.624425:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787430935.624523:0:17854:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787430935.624531:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a951e4 00000020:00000080:0.0:1787430935.624941:0:17854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787430935.624946:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430935.624950:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430935.624951:0:17854:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787430935.624954:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430935.624963:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430935.624965:0:17854:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787430935.624969:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430935.624976:0:17854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8e2c3bd419b8) 00000020:00000080:0.0:1787430935.624987:0:17854:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787430935.624991:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787430935.624994:0:17854:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787430935.624996:0:17854:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787430935.625002:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787430935.625060:0:17854:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c08afe800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787430935.625071:0:17854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8e2c3bd40000) 00000020:00000080:0.0:1787430935.625081:0:17854:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787430935.625212:0:17854:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787430935.625217:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a951f9 00000020:00000080:0.0:1787430935.625320:0:17854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787430935.625327:0:17854:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787430935.625331:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4dbb683ba6a95200 00080000:01000000:0.0:1787430935.625338:0:17854:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787430935.625341:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a95207 00010000:00010000:0.0:1787430935.680641:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430935.712948:0:17854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787430935.713373:0:17854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787430935.713765:0:17854:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787430935.714638:0:17854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787430935.714656:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430935.714664:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430935.714672:0:17854:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787430935.714677:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430935.714681:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430935.714683:0:17854:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787430935.714686:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787430935.714691:0:17854:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:2.0:1787430935.714718:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430935.714733:0:17854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8e2b03558000) 00000020:00000080:2.0:1787430935.714751:0:17854:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787430935.714756:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787430935.714834:0:17854:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787430935.714840:0:17854:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787430935.714852:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a95215 00010000:00080000:2.0:1787430935.714882:0:17854:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c03ead000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1787430935.716549:0:17854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787430935.720885:0:17854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787430935.720903:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787430935.720940:0:17854:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787430935.720970:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a9521c 00000100:00080000:1.0:1787430935.720981:0:17854:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430935.720986:0:17854:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2c03ead000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430935.721024:0:17854:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac1500 x1874256847854720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430935.721093:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847854720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787430935.721166:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430935.721275:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854720 00000100:00100000:3.0:1787430935.721283:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854720 00000100:00100000:3.0:1787430935.721321:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430935.721331:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1874256847854720:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787430935.721357:0:17126:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:3.0:1787430935.721385:0:17126:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a95223 00000004:00100000:3.0:1787430935.721399:0:17126:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787430935.721405:0:17126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787430935.721496:0:17854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787430935.721564:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.721569:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.721570:0:17854:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787430935.721573:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787430935.721576:0:17854:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787430935.721577:0:17854:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430935.721579:0:17854:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430935.721581:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787430935.721583:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.721585:0:17854:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787430935.721587:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430935.721591:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.721592:0:17854:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787430935.721596:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787430935.721646:0:17854:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787430935.721795:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.721800:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.721802:0:17854:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787430935.721804:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787430935.721806:0:17854:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1787430935.721807:0:17854:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430935.721809:0:17854:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430935.721811:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787430935.721813:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.721814:0:17854:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787430935.721817:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787430935.721820:0:17854:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787430935.721831:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.721833:0:17854:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787430935.721837:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787430935.721840:0:17854:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1787430935.721861:0:17854:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787430935.721864:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787430935.721876:0:17854:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e2c35deb370) 00000020:00000080:1.0:1787430935.721887:0:17854:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787430935.721892:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787430935.721956:0:17854:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787430935.721963:0:17854:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787430935.721969:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a95231 00010000:00080000:1.0:1787430935.721998:0:17854:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c079a1000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1787430935.722202:0:17854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1787430935.722702:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787430935.722707:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787430935.722710:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430935.722715:0:9961:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:3.0:1787430935.722720:0:9961:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787430935.722725:0:9961:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2c042f7800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430935.722751:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b1aa00 x1874256847854848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:1.0:1787430935.726816:0:17854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787430935.727197:0:17854:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787430935.728772:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430935.728954:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787430935.729107:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:2.0:1787430935.729261:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847854848:0@lo:38:kworker.0 00000100:00100000:2.0:1787430935.729336:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.729511:0:17125:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787430935.729519:0:17125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:3.0:1787430935.732984:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430935.732993:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430935.732995:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430935.732998:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787430935.733255:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847854976:0@lo:400:kworker.0 00000100:00100000:3.0:1787430935.733327:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430935.733383:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854976 00000100:00100000:3.0:1787430935.733391:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854976 00000100:00100000:3.0:1787430935.733437:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430935.733446:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847854976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430935.733501:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847854976:12345-0@lo:400:kworker.0 Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.733509:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787430935.733569:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2b03b1a680 x1874256847854976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430935.733584:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847854976:0@lo:400:kworker.0 00000100:00100000:3.0:1787430935.733976:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847854848 00000100:00100000:3.0:1787430935.733982:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847854848 00000100:00100000:0.0:1787430935.734106:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430935.734113:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1874256847854848:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787430935.734176:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1874256847854848:12345-0@lo:38:kworker.0 Request processed in 63us (4840us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787430935.734183:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430935.734265:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430935.734272:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430935.734276:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787430935.734280:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847854848:0@lo:38:kworker.0 00000040:00080000:1.0:1787430935.734480:0:17859:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787430935.734485:0:17859:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787430935.735321:0:17854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787430935.735333:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787430935.735370:0:17854:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787430935.735397:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a95238 00000100:00080000:1.0:1787430935.735405:0:17854:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430935.735410:0:17854:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e2c079a1000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430935.735435:0:17854:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac3b80 x1874256847855104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430935.735473:0:17854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787430935.735528:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.735534:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.735536:0:17854:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787430935.735641:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787430935.735644:0:17854:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787430935.735646:0:17854:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430935.735647:0:17854:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1787430935.735756:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847855104:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787430935.735796:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847855104 offset 0 length 520: 4 00000020:01000000:1.0:1787430935.735859:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787430935.735865:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.735866:0:17854:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787430935.735871:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787430935.735875:0:17854:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787430935.735879:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.735880:0:17854:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787430935.735883:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787430935.735887:0:17854:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1787430935.735907:0:17854:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787430935.735910:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787430935.735923:0:17854:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e2c35de99b8) 00000020:00000080:1.0:1787430935.735936:0:17854:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787430935.735940:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787430935.736001:0:17854:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787430935.736009:0:17854:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787430935.736014:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4dbb683ba6a95246 00010000:00080000:1.0:1787430935.736044:0:17854:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b03dc6800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1787430935.736259:0:17854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787430935.736328:0:17854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787430935.736343:0:17854:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787430935.736793:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430935.736799:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430935.736802:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430935.736804:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787430935.738222:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430935.738853:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787430935.739025:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787430935.739440:0:17862:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787430935.739444:0:17862:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787430935.740395:0:17854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787430935.740407:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787430935.740446:0:17854:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787430935.740467:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a9524d 00000100:00080000:1.0:1787430935.740478:0:17854:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430935.740483:0:17854:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e2b03dc6800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430935.740518:0:17854:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac1c00 x1874256847855232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787430935.740626:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847855232:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787430935.740700:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847855232 offset 0 length 520: 4 00000100:00080000:1.0:1787430935.740775:0:17854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787430935.740828:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.740832:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.740835:0:17854:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787430935.740838:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430935.740842:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.740844:0:17854:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787430935.740847:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787430935.740849:0:17854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787430935.740852:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.740854:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.740855:0:17854:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787430935.740858:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430935.740861:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.740862:0:17854:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787430935.740867:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787430935.740892:0:17854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.740894:0:17854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.740896:0:17854:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787430935.740899:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1787430935.740952:0:17850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787430935.740991:0:17850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787430935.741012:0:17850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4e00/0x4dbb683ba6a951cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951d6 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.741023:0:17850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4e00/0x4dbb683ba6a951cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a951d6 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.741032:0:17850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c08afe800 from 1 10000000:01000000:1.0:1787430935.741035:0:17850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787430935.741061:0:17850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.741069:0:17850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.741081:0:17850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.741097:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787430935.741135:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.741154:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430935.741174:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847855360 00000100:00100000:1.0:1787430935.741180:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847855360 00000100:00100000:1.0:1787430935.741220:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787430935.741229:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+15:17850:x1874256847855360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430935.741251:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430935.741262:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95254 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.741283:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 16 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.741301:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 16 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.741309:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4400, rc 0) 00000100:00100000:1.0:1787430935.741342:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:17850:x1874256847855360:12345-0@lo:101:mount.lustre.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.741349:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787430935.741395:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430935.741408:0:17850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.741417:0:17850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.741975:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855488:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787430935.742010:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.742027:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1787430935.742625:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430935.742654:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430935.742658:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430935.742661:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430935.744017:0:17126:0:(import.c:65:import_set_state_nolock()) ffff8e2b03b45800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430935.744230:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3626:x1874256847854720:12345-0@lo:38:llog_process_th.0 Request processed in 22895us (23059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.744251:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430935.744318:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430935.744327:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787430935.744336:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787430935.744342:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787430935.744352:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c03ead000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787430935.744402:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847854720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787430935.744432:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847855488 00000100:00100000:3.0:1787430935.744438:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847855488 00000100:00100000:3.0:1787430935.744487:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430935.744496:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:17850:x1874256847855488:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787430935.744512:0:17114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787430935.744550:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787430935.744554:0:17114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787430935.744942:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:17850:x1874256847855488:12345-0@lo:256:mount.lustre.0 Request processed in 447us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.744950:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787430935.745043:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855488:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787430935.745646:0:17850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787430935.745672:0:17850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430935.745683:0:17850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430935.745691:0:17850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c08afe800 from 1 10000000:01000000:2.0:1787430935.745694:0:17850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430935.745731:0:17850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430935.745739:0:17850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430935.745748:0:17850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430935.745766:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430935.745803:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430935.745840:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.746028:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847855616 00000100:00100000:3.0:1787430935.746034:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847855616 00000100:00100000:3.0:1787430935.746074:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787430935.746083:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:17850:x1874256847855616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430935.746093:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430935.746106:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95262 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.746125:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.746135:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430935.746143:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8aa00, rc 0) 00000100:00100000:3.0:1787430935.746172:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847855616:12345-0@lo:101:mount.lustre.0 Request processed in 91us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.746184:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787430935.746696:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430935.746710:0:17850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430935.746719:0:17850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430935.746858:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430935.746891:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430935.746918:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430935.746936:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.747077:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847855744 00000100:00100000:3.0:1787430935.747082:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847855744 00000100:00100000:3.0:1787430935.747116:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787430935.747123:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847855744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430935.747211:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847855744:12345-0@lo:501:mount.lustre.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.747218:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430935.747323:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430935.747346:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430935.747383:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430935.747408:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03af3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.747458:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847855872 00000100:00100000:3.0:1787430935.747463:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847855872 00000100:00100000:3.0:1787430935.747495:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787430935.747503:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847855872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787430935.747596:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847855872:12345-0@lo:503:mount.lustre.0 Request processed in 93us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.747626:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787430935.747752:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847855872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787430935.748096:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430935.748167:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430935.748203:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.748226:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430935.748252:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856000 00000100:00100000:0.0:1787430935.748256:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856000 00000100:00100000:3.0:1787430935.748563:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847856128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430935.748595:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.748788:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856128 00000100:00100000:1.0:1787430935.748793:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856128 00000100:00100000:1.0:1787430935.748831:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430935.748839:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3630:x1874256847856128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787430935.748862:0:17125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787430935.748901:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3630:x1874256847856128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.748906:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430935.749090:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847856128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430935.749169:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787430935.749178:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847856000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430935.749403:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847856000:12345-0@lo:502:mount.lustre.0 Request processed in 226us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.749410:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787430935.749471:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430935.749887:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787430935.749917:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787430935.749933:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787430935.749946:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787430935.749958:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787430935.749971:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787430935.749983:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787430935.749996:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787430935.750009:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787430935.750021:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787430935.750033:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787430935.750061:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430935.750101:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.750122:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787430935.750183:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856256 00000100:00100000:2.0:1787430935.750194:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856256 00000100:00100000:2.0:1787430935.750243:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787430935.750251:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847856256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430935.750333:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847856256:12345-0@lo:502:mount.lustre.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430935.750340:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430935.750449:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430935.750488:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787430935.750495:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787430935.751163:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430935.751173:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.751175:0:17864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787430935.751186:0:17864:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c08afe800 00000020:00000080:1.0:1787430935.751189:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787430935.751196:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.751199:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.751200:0:17864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787430935.751203:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430935.751206:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.751207:0:17864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787430935.751211:0:17864:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c08afe800 00000020:00000080:1.0:1787430935.751213:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787430935.751328:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.751333:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.751334:0:17864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787430935.751337:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430935.751339:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.751340:0:17864:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787430935.751344:0:17864:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c08afe800 00000020:00000080:1.0:1787430935.751346:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787430935.761346:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.761434:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.761437:0:17864:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787430935.761446:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430935.761451:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.761453:0:17864:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787430935.761457:0:17864:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c08afe800 00000020:00000080:1.0:1787430935.761459:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787430935.761519:0:17864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430935.761522:0:17864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430935.761524:0:17864:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787430935.761527:0:17864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1787430935.766773:0:17850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787430935.766822:0:17850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430935.766851:0:17850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430935.766864:0:17850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430935.766931:0:17850:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787430935.766935:0:17850:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2c08afe800 10000000:01000000:0.0:1787430935.766937:0:17850:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2c08afe800 10000000:01000000:0.0:1787430935.766941:0:17850:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430935.766946:0:17850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c08afe800 from 1 10000000:01000000:0.0:1787430935.766949:0:17850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430935.766985:0:17850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a95270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430935.767361:0:17850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a95270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430935.767378:0:17850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a95270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430935.767409:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430935.767485:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.767532:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89840 going to sleep for 11 seconds 00000100:00100000:2.0:1787430935.768860:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856384 00000100:00100000:2.0:1787430935.768873:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856384 00000100:00100000:2.0:1787430935.768955:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787430935.768966:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17850:x1874256847856384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430935.768979:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430935.768996:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f03800/0x4dbb683ba6a95277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95270 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430935.769022:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f03800/0x4dbb683ba6a95277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95270 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430935.769034:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f03800/0x4dbb683ba6a95277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95270 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430935.769044:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03800, rc 0) 00000100:00100000:2.0:1787430935.769114:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856384:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430935.769122:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787430935.769193:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430935.769209:0:17850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a95270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95277 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.769219:0:17850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a95270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95277 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430935.772700:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787430935.773017:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430935.773244:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787430935.773273:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1787430935.773291:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1787430935.773318:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1787430935.773335:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1787430935.773350:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1787430935.773381:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1787430935.773398:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1787430935.773412:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1787430935.773426:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1787430935.773440:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1787430935.773455:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1787430935.773477:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1787430935.773492:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1787430935.773504:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1787430935.773517:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1787430935.773531:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1787430935.773561:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1787430935.773578:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1787430935.773594:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1787430935.773635:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1787430935.773650:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1787430935.773681:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1787430935.773699:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1787430935.773714:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1787430935.773726:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1787430935.773739:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1787430935.773753:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1787430935.773774:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1787430935.773781:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787430935.773860:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430935.773929:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.776596:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430935.778051:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856512 00000100:00100000:0.0:1787430935.778060:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856512 00000100:00100000:0.0:1787430935.778106:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787430935.778113:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430935.778286:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856512:12345-0@lo:501:mount.lustre.0 Request processed in 172us (4356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.778295:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430935.778519:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430935.779773:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430935.779843:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.779891:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856640 00000100:00100000:1.0:1787430935.779897:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856640 00000100:00100000:1.0:1787430935.779934:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787430935.779943:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430935.780036:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856640:12345-0@lo:503:mount.lustre.0 Request processed in 93us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.780043:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787430935.780093:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787430935.780116:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787430935.782960:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430935.783060:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430935.783143:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.783184:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856768 00000100:00100000:1.0:1787430935.783191:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856768 00000100:00100000:1.0:1787430935.783281:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787430935.783292:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430935.783409:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856768:12345-0@lo:502:mount.lustre.0 Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.783417:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787430935.785875:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787430935.785910:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430935.786136:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787430935.786167:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1787430935.786191:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1787430935.786205:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1787430935.786217:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1787430935.786243:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1787430935.786261:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1787430935.786289:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1787430935.786306:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1787430935.786320:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1787430935.786332:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1787430935.786346:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1787430935.786359:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1787430935.786372:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1787430935.786385:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1787430935.788750:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1787430935.788784:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1787430935.788798:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1787430935.788810:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1787430935.788823:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1787430935.788837:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1787430935.788850:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1787430935.788865:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1787430935.788896:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1787430935.788912:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1787430935.788926:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1787430935.788940:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1787430935.788952:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1787430935.788965:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1787430935.788978:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1787430935.788991:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1787430935.789004:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1787430935.789015:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1787430935.789028:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1787430935.789040:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1787430935.789064:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1787430935.789076:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1787430935.789088:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1787430935.789098:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1787430935.789118:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1787430935.789131:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1787430935.789144:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1787430935.789155:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1787430935.789166:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1787430935.789177:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1787430935.789188:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1787430935.789201:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1787430935.789213:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1787430935.789286:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430935.789363:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.789411:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.789721:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847856896 00000100:00100000:3.0:1787430935.789731:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847856896 00000100:00100000:3.0:1787430935.789787:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787430935.789799:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430935.789985:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847856896:12345-0@lo:502:mount.lustre.0 Request processed in 187us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.790004:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787430935.791480:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847856896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430935.791892:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1787430935.791926:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1787430935.791966:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847857024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430935.792208:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.792298:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.792343:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857024 00000100:00100000:3.0:1787430935.792349:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857024 00000100:00100000:3.0:1787430935.792423:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430935.792433:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847857024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430935.792557:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847857024:12345-0@lo:502:mount.lustre.0 Request processed in 124us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.792564:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787430935.792688:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847857024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430935.792736:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1787430935.792752:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787430935.795968:0:17869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787430935.796001:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8e2c35decd28) 00000020:00000080:1.0:1787430935.796028:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787430935.796107:0:17869:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c08afe800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787430935.796111:0:17869:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c08afe800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787430935.796114:0:17869:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c08afe800 3 00010000:00080000:1.0:1787430935.796155:0:17869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2c18c0e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1787430935.806464:0:17869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1787430935.806974:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787430935.807019:0:17869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787430935.807036:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4dbb683ba6a95285 00000100:00080000:1.0:1787430935.807047:0:17869:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430935.807053:0:17869:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2c18c0e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430935.807104:0:17869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b04ac2a00 x1874256847857152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430935.807135:0:17869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787430935.807279:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847857152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787430935.807357:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787430935.807761:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430935.807767:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430935.807770:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430935.807773:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787430935.808438:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857152 00000100:00100000:1.0:1787430935.808447:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857152 00000100:00100000:1.0:1787430935.808491:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430935.808500:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847857152:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787430935.808525:0:17122:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:1.0:1787430935.808571:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4dbb683ba6a9528c 00000004:00100000:1.0:1787430935.808590:0:17122:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787430935.810449:0:17122:0:(import.c:65:import_set_state_nolock()) ffff8e2b03dc3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430935.810553:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874256847857152:12345-0@lo:38:llog_process_th.0 Request processed in 2049us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.810563:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787430935.810641:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2b04ac2a00 x1874256847857152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430935.810653:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430935.810661:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787430935.810670:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787430935.810674:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787430935.810676:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c18c0e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787430935.810692:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874256847857152:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787430935.826431:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1787430935.826495:0:17850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787430935.826522:0:17850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430935.826554:0:17850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a95270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95277 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430935.826567:0:17850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175c00/0x4dbb683ba6a95270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95277 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787430935.826645:0:17850:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787430935.826647:0:17850:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787430935.826649:0:17850:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430935.826650:0:17850:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430935.826651:0:17850:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430935.826653:0:17850:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430935.826654:0:17850:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430935.826656:0:17850:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430935.826658:0:17850:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430935.826662:0:17850:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787430935.826665:0:17850:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430935.826666:0:17850:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787430935.826667:0:17850:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430935.826668:0:17850:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430935.826669:0:17850:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430935.826670:0:17850:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430935.826671:0:17850:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430935.826672:0:17850:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430935.826673:0:17850:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430935.826703:0:17850:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787430935.826725:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847857280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787430935.826800:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.826842:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c35f89000 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.827025:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857280 00000100:00100000:3.0:1787430935.827033:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857280 00000100:00100000:3.0:1787430935.827084:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430935.827094:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17850:x1874256847857280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787430935.827124:0:17114:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787430935.827138:0:17114:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787430935.828553:0:17100:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787430935.828649:0:17114:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787430935.828666:0:17114:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787430935.828710:0:17136:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787430935.828715:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787430935.828736:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.828752:0:17136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.828760:0:17136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 18 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.828768:0:17136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.828802:0:17136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 18 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.828815:0:17136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 18 pid: 17112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.828827:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847857408:0@lo:104: 00000100:00100000:1.0:1787430935.828874:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430935.828917:0:17136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.828925:0:17136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 18 pid: 17115 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.828948:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847857536:0@lo:104: 00000100:00100000:1.0:1787430935.828971:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.828987:0:17136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c116b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430935.829005:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857408 00000100:00100000:1.0:1787430935.829010:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857408 00000100:00100000:1.0:1787430935.829037:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857536 00000100:00100000:1.0:1787430935.829039:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857536 00000100:00100000:1.0:1787430935.829052:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430935.829060:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:17136:x1874256847857408:12345-0@lo:104: 00010000:00010000:1.0:1787430935.829072:0:17104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829121:0:17104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430935.829127:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:17136:x1874256847857408:12345-0@lo:104: Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.829134:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430935.829150:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430935.829172:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847857536:12345-0@lo:104: 00010000:00010000:1.0:1787430935.829180:0:17104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829212:0:17104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430935.829218:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847857536:12345-0@lo:104: Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.829224:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787430935.829250:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430935.829256:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829268:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430935.829272:0:17108:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829280:0:17108:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430935.829288:0:17108:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.829294:0:17108:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430935.829317:0:17108:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829324:0:17108:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430935.829342:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829349:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4200/0x4dbb683ba6a95254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a9525b expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829362:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430935.829365:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829371:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42174000 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430935.829374:0:17108:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829391:0:17108:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430935.829397:0:17108:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430935.829403:0:17108:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430935.829415:0:17108:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829420:0:17108:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430935.829426:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829433:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42174000/0x4dbb683ba6a95190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95197 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829446:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430935.829448:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430935.829449:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430935.829455:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430935.829467:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847857664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430935.829494:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.829515:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430935.829520:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847857792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430935.829540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.829571:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857664 00000100:00100000:1.0:1787430935.829575:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857664 00010000:00010000:1.0:1787430935.829597:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 19 pid: 17112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.829637:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857792 00000100:00100000:1.0:1787430935.829640:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857792 00010000:00010000:1.0:1787430935.829656:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 20 pid: 17115 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.829670:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430935.829677:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:3627:x1874256847857664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430935.829686:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430935.829691:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 20 pid: 17112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829701:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 20 pid: 17112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829714:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430935.829741:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:3627:x1874256847857664:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.829748:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430935.829761:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430935.829768:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:3627:x1874256847857792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430935.829776:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430935.829780:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 19 pid: 17115 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829789:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 19 pid: 17115 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829809:0:17105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829816:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787430935.829827:0:17105:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001112732s 00010000:00010000:1.0:1787430935.829831:0:17105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829838:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829845:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829851:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829856:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4c00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430935.829861:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829867:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829875:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.829883:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430935.829904:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:3627:x1874256847857792:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.829914:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430935.829946:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847857792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430935.829953:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847857664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430935.829976:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2b03ce4400/0x4dbb683ba6a9525b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a95254 expref: 18 pid: 17112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.829985:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847857408:0@lo:104: 00010000:00010000:1.0:1787430935.829994:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2b03ce5800/0x4dbb683ba6a95197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a95190 expref: 17 pid: 17115 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430935.830002:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847857536:0@lo:104: 00010000:00010000:1.0:1787430935.830013:0:17136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.830022:0:17136:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.830028:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430935.830035:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a95293 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430935.832353:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:17850:x1874256847857280:12345-0@lo:253:mount.lustre.0 Request processed in 5253us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430935.832366:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787430935.832472:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17850:1874256847857280:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787430935.832486:0:17850:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787430935.832490:0:17850:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430935.832492:0:17850:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787430935.832500:0:17850:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430935.832501:0:17850:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430935.832502:0:17850:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430935.832504:0:17850:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430935.832505:0:17850:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430935.832507:0:17850:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430935.832509:0:17850:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787430935.832522:0:17850:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1787430935.843557:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787430935.843560:0:17875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787430935.843569:0:17875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787430935.846771:0:17876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787430935.846922:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787430935.847355:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17877:1874256847857920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787430935.847426:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.847454:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c14900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430935.847520:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847857920 00000100:00100000:0.0:1787430935.847532:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847857920 00000100:00100000:0.0:1787430935.847579:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430935.847589:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17877:x1874256847857920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787430935.847683:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17877:x1874256847857920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.847692:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:0.0:1787430935.847810:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787430935.847842:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787430935.848286:0:17850:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787430935.848292:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787430935.848324:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430935.849277:0:17850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787430935.849793:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430935.849801:0:17850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787430935.849829:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787430935.849894:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787430935.850445:0:17850:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1787430935.850872:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17877:1874256847857920:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787430935.850904:0:17877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787430935.850941:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17877:1874256847858048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787430935.851008:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430935.851040:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03c14900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430935.851376:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858048 00000100:00100000:0.0:1787430935.851382:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858048 00000100:00100000:0.0:1787430935.851419:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430935.851427:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17877:x1874256847858048:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787430935.851527:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17877:x1874256847858048:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 101us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.851534:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430935.851658:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17877:1874256847858048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787430935.851707:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17877:1874256847858176:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787430935.851737:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.851759:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430935.851857:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858176 00000100:00100000:1.0:1787430935.851862:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858176 00000100:00100000:1.0:1787430935.851928:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430935.851937:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17877:x1874256847858176:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787430935.851977:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17877:x1874256847858176:12345-0@lo:900:lod0001_rec0000.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.851984:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787430935.852088:0:17877:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2b03ae3b80 x1874256847858176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787430951 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430935.852108:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17877:1874256847858176:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787430935.852144:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17877:1874256847858304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787430935.852177:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430935.852244:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430935.852756:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858304 00000100:00100000:3.0:1787430935.852762:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858304 00000001:00000004:1.0:1787430935.853259:0:17850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787430935.853431:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430935.853442:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17877:x1874256847858304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787430935.853527:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17877:x1874256847858304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 88us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.853540:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430935.853626:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17877:1874256847858304:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787430935.853669:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430935.855218:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787430935.855288:0:17876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1787430935.856427:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787430935.856483:0:17877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787430935.856497:0:17877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1787430935.858750:0:17850:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787430935.858786:0:17850:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9cc94151f988 00100000:10000000:1.0:1787430935.858795:0:17850:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787430935.861426:0:17850:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787430935.861462:0:17850:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787430935.861487:0:17850:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787430935.861506:0:17850:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787430935.862226:0:17850:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430935.862443:0:17850:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787430936.005432:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00010000:00010000:1.0:1787430936.710815:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430936.841729:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787430937.024281:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787430937.028788:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 10000000:01000000:3.0:1787430937.727770:0:17117:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430937.727780:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c08afe800 from 8 10000000:01000000:3.0:1787430937.727786:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430937.727836:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.727851:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.727863:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430937.727889:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430937.727961:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430937.728010:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e65900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430937.728032:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858432 00000100:00100000:3.0:1787430937.728039:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858432 00000100:00100000:3.0:1787430937.728086:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430937.728095:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:17117:x1874256847858432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430937.728108:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430937.728121:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9529a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.728142:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 17 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.728153:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 17 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.728170:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:3.0:1787430937.728209:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847858432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430937.728228:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430937.728277:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430937.728293:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.728303:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430937.728348:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787430937.728377:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430937.728401:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e65900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430937.728513:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858560 00000100:00100000:1.0:1787430937.728518:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858560 00000100:00100000:1.0:1787430937.728554:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430937.728562:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847858560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787430937.728578:0:17114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430937.728594:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430937.728597:0:17114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787430937.728704:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847858560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430937.728713:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430937.728749:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787430937.728791:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787430937.728799:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430937.728808:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430937.728822:0:17117:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787430937.728825:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a7800 from 8 10000000:01000000:1.0:1787430937.728827:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787430937.728843:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430937.728851:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430937.728859:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430937.728872:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430937.728899:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430937.728930:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b94600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430937.729261:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858688 00000100:00100000:3.0:1787430937.729267:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858688 00000100:00100000:3.0:1787430937.729305:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787430937.729314:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847858688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430937.729321:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430937.729332:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a952a8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.729347:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.729356:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430937.729369:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b400, rc 0) 00000100:00100000:3.0:1787430937.729400:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847858688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430937.729406:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787430937.729429:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430937.729444:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430937.729453:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430937.729496:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787430937.729523:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430937.729546:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b94600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430937.729700:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858816 00000100:00100000:3.0:1787430937.729705:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858816 00000100:00100000:3.0:1787430937.729731:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787430937.729739:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847858816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787430937.729750:0:17114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787430937.729764:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787430937.729768:0:17114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787430937.729826:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847858816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430937.729831:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787430937.733968:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847858816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787430937.734523:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787430937.734541:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430937.734556:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430937.735797:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430937.856436:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787430938.047726:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00010000:00010000:1.0:1787430938.752808:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430938.823894:0:18119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787430939.073694:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000020:00000004:2.0:1787430939.462470:0:18172:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430939.462964:0:18172:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787430939.776446:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787430940.064500:0:18222:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430940.064731:0:18222:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787430940.096831:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 0 seconds 00000020:00000080:3.0:1787430940.719811:0:18270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1e3f1bb0 20000000:00000080:3.0:1787430940.719829:0:18270:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2c18230800 uarg=0000000000000000 20000000:01000000:3.0:1787430940.719870:0:18270:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787430940.719877:0:18270:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787430940.719882:0:18270:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787430940.720302:0:18271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787430940.720505:0:18270:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787430940.726385:0:18270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787430940.726506:0:18270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.726524:0:18270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 17 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.726546:0:18270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.726553:0:18270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.726593:0:18270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.726738:0:18270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 17 pid: 17115 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430940.726753:0:18270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18270:1874256847858944:0@lo:104: 00000100:00100000:3.0:1787430940.726817:0:18270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430940.726884:0:18270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 17 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.726893:0:18270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 17 pid: 17114 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430940.726901:0:18270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18270:1874256847859072:0@lo:104: 00000100:00100000:3.0:1787430940.726923:0:18270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430940.726945:0:18270:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430940.727000:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847858944 00000100:00100000:0.0:1787430940.727008:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847858944 00000100:00100000:0.0:1787430940.727048:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859072 00000100:00100000:0.0:1787430940.727051:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859072 00000100:00100000:0.0:1787430940.727066:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430940.727075:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:18270:x1874256847858944:12345-0@lo:104: 00010000:00010000:0.0:1787430940.727088:0:17103:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727155:0:17103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430940.727162:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:18270:x1874256847858944:12345-0@lo:104: Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430940.727170:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430940.727196:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430940.727203:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:18270:x1874256847859072:12345-0@lo:104: 00010000:00010000:0.0:1787430940.727211:0:17103:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727243:0:17103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787430940.727256:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:18270:x1874256847859072:12345-0@lo:104: Request processed in 54us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430940.727264:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787430940.727282:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430940.727288:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727296:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430940.727300:0:17109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727309:0:17109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430940.727316:0:17109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430940.727322:0:17109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787430940.727352:0:17109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727359:0:17109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430940.727379:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727386:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02a00/0x4dbb683ba6a95262 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95269 expref: -99 pid: 17850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727458:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430940.727461:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727479:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c42175200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430940.727481:0:17109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727489:0:17109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430940.727494:0:17109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430940.727499:0:17109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787430940.727514:0:17109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727519:0:17109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430940.727526:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727532:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c42175200/0x4dbb683ba6a9515f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95166 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430940.727547:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430940.727549:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430940.727551:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430940.727565:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847859200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430940.727595:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430940.727651:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430940.727657:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847859328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430940.727689:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430940.727842:0:18270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18270:1874256847858944:0@lo:104: 00000100:00100000:3.0:1787430940.727852:0:18270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18270:1874256847859072:0@lo:104: 00010000:00010000:3.0:1787430940.727873:0:18270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430940.728143:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430940.728161:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859200 00000100:00100000:1.0:1787430940.728166:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859200 00010000:00010000:1.0:1787430940.728205:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 18 pid: 17115 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430940.728262:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859328 00000100:00100000:1.0:1787430940.728266:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859328 00010000:00010000:1.0:1787430940.728279:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 19 pid: 17114 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430940.728312:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430940.728321:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:3629:x1874256847859200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430940.728332:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430940.728338:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 19 pid: 17115 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728348:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 19 pid: 17115 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728362:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95269 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a95262 expref: 19 pid: 17115 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728374:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430940.728560:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:3629:x1874256847859200:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430940.728567:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430940.728583:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430940.728590:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:3629:x1874256847859328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430940.728598:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430940.728912:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 17 pid: 17114 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728922:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 17 pid: 17114 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728932:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a95166 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a9515f expref: 17 pid: 17114 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728955:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728963:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728978:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728985:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728991:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.728997:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.729002:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ae00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430940.729006:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.729013:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430940.732496:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847859200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430940.733801:0:18270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430940.733819:0:18270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.735061:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.735077:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952b6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430940.735108:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430940.735213:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:3629:x1874256847859328:12345-0@lo:103:ldlm_bl.0 Request processed in 6618us (7517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430940.735223:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430940.735322:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847859328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430940.803369:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430940.927944:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787430940.927951:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787430940.927954:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430940.927963:0:9961:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2c042f7800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430940.927994:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b18380 x1874256847859456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430940.928007:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430940.928010:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430940.928012:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430940.928014:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430940.928030:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430940.928032:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430940.928034:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430940.928044:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787430940.928085:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430940.928096:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847859840:0@lo:400:kworker.0 00000100:00100000:0.0:1787430940.928208:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430940.928349:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859840 00000100:00100000:3.0:1787430940.928356:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859840 00000100:00100000:3.0:1787430940.928401:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430940.928407:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847859840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430940.928461:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847859840:12345-0@lo:400:kworker.0 Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430940.928466:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430940.928545:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847859584:0@lo:400:kworker.0 00000100:00100000:1.0:1787430940.928589:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430940.928635:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430940.928639:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847859712:0@lo:400:kworker.0 00000100:00100000:1.0:1787430940.928670:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430940.928691:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430940.928695:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847859968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430940.928708:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430940.928722:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847859456:0@lo:38:kworker.0 00000100:00100000:1.0:1787430940.928743:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430940.928857:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859712 00000100:00100000:1.0:1787430940.928860:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859712 00000100:00100000:1.0:1787430940.928876:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859968 00000100:00100000:1.0:1787430940.928877:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859968 00000100:00100000:1.0:1787430940.928883:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859456 00000100:00100000:1.0:1787430940.928884:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859456 00000100:00100000:1.0:1787430940.928890:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430940.928894:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1874256847859712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430940.928921:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1874256847859712:12345-0@lo:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430940.928925:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430940.928933:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430940.928936:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847859968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787430940.928953:0:17125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787430940.928986:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847859968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430940.928990:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430940.928997:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430940.929000:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874256847859456:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787430940.929016:0:17125:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 402 last 0 00000100:00100000:0.0:1787430940.929115:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847859584 00000100:00100000:0.0:1787430940.929119:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847859584 00000100:00100000:0.0:1787430940.929137:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430940.929141:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847859584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430940.929163:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847859584:12345-0@lo:400:kworker.0 Request processed in 22us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430940.929167:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787430940.929219:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2b03b1b800 x1874256847859840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430940.929232:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847859840:0@lo:400:kworker.0 00000020:00000080:1.0:1787430940.929877:0:17125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a952bd 00000004:00100000:1.0:1787430940.929891:0:17125:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787430940.929895:0:17125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787430940.929960:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847859968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430940.929975:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847859712:0@lo:400:kworker.0 00010000:00080000:1.0:1787430940.929991:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2b03b19880 x1874256847859584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430940.929997:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847859584:0@lo:400:kworker.0 00000100:00080000:3.0:1787430940.935993:0:17125:0:(import.c:65:import_set_state_nolock()) ffff8e2b03fe4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430940.936119:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1874256847859456:12345-0@lo:38:kworker.0 Request processed in 7114us (7371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430940.936131:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787430940.936300:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787430940.936310:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787430940.936315:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787430940.936318:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c042f7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787430940.936339:0:3626:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000674fcb25): req@ffff8e2b04ac2300 x1874256847852160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430940.936363:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847859456:0@lo:38:kworker.0 00000100:00100000:0.0:1787430940.936528:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430940.936624:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02f6b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787430940.936738:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847852160 00000100:00100000:1.0:1787430940.936744:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847852160 00000100:00100000:1.0:1787430940.936786:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787430940.936794:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17161:x1874256847852160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787430940.936861:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17161:x1874256847852160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430940.936869:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787430940.936884:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430940.936892:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847860096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430940.936913:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430940.936944:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17161:1874256847852160:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787430940.936972:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787430940.937000:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac2300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17161:1874256847860224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787430940.937025:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430940.937063:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b94c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430940.937073:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860096 00000100:00100000:1.0:1787430940.937076:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860096 00000100:00100000:1.0:1787430940.937089:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860224 00000100:00100000:1.0:1787430940.937092:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860224 00000100:00100000:1.0:1787430940.937102:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787430940.937107:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3628:x1874256847860096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787430940.937127:0:17126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787430940.937157:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3628:x1874256847860096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430940.937164:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787430940.937195:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430940.937201:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17161:x1874256847860224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787430940.937277:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17161:x1874256847860224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430940.937283:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430940.937307:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847860096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430940.937325:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17161:1874256847860224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787430940.937384:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ace00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17161:1874256847860352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787430940.937404:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430940.937416:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b94c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430940.937426:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860352 00000100:00100000:1.0:1787430940.937429:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860352 00000100:00100000:1.0:1787430940.937443:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430940.937448:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17161:x1874256847860352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787430940.937486:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17161:x1874256847860352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 37us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430940.937497:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430940.937518:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ace00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17161:1874256847860352:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787430940.937549:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430940.939570:0:17161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787430940.939652:0:17161:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 15, retries 0 00000004:00080000:1.0:1787430940.939656:0:17161:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787430941.830243:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787430942.656017:0:17117:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430942.656024:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c08afe800 from 13 10000000:01000000:1.0:1787430942.656028:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430942.656066:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430942.656075:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430942.656083:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430942.656102:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430942.656155:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430942.656243:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b940c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430942.656469:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860480 00000100:00100000:3.0:1787430942.656475:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860480 00000100:00100000:3.0:1787430942.656541:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787430942.656548:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+16:17117:x1874256847860480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430942.656559:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430942.656572:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a952c4 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430942.656689:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430942.656702:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430942.656712:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8bc00, rc 0) 00000100:00100000:3.0:1787430942.656755:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847860480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430942.656760:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787430942.656837:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430942.656849:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430942.656856:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430942.656905:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430942.656924:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430942.657047:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02d979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430942.657101:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860608 00000100:00100000:1.0:1787430942.657105:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860608 00000100:00100000:1.0:1787430942.657122:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787430942.657126:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847860608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430942.657242:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847860608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430942.657257:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787430942.657305:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430942.657339:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430942.657367:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430942.657382:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02d979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430942.657452:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860736 00000100:00100000:1.0:1787430942.657455:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860736 00000100:00100000:1.0:1787430942.657467:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430942.657471:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847860736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430942.657535:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847860736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430942.657542:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787430942.657630:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787430942.658538:0:18409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787430942.658893:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787430942.658913:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430942.658922:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430942.658932:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430942.658942:0:17117:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430942.658945:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a7800 from 13 10000000:01000000:1.0:1787430942.658948:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430942.658973:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430942.658981:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430942.658989:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430942.659006:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430942.659049:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430942.667459:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b94c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430942.667522:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860864 00000100:00100000:3.0:1787430942.667531:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860864 00000100:00100000:3.0:1787430942.667710:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430942.667731:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+17:17117:x1874256847860864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430942.667749:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430942.667766:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a952d2 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430942.667793:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 18 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430942.667805:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 18 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430942.667828:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ae00, rc 0) 00000100:00100000:3.0:1787430942.667901:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847860864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (8851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430942.667954:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430942.667970:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430942.667977:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430942.668042:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430942.668075:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430942.668091:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430942.668102:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847860992 00000100:00100000:0.0:1787430942.668104:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847860992 00000100:00100000:3.0:1787430942.669272:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787430942.669643:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787430942.669656:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847860992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430942.669783:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847860992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430942.669788:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787430942.669977:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847860992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430942.670010:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847861120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430942.670044:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430942.670150:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02d979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430942.670222:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847861120 00000100:00100000:1.0:1787430942.670227:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847861120 00000100:00100000:1.0:1787430942.670250:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787430942.670255:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847861120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430942.670326:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:17117:x1874256847861120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430942.670332:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787430942.670423:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847861120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787430942.671069:0:18414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787430942.671248:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787430942.671268:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430942.671276:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430942.671284:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430942.849787:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430943.872298:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430944.899079:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430945.030851:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430935/real 1787430935] req@ffff8e2b04ac1c00 x1874256847855232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430945.030880:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b04ac1c00 x1874256847855232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430945.032831:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430935/real 1787430935] req@ffff8e2b04ac3b80 x1874256847855104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430945.032858:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b04ac3b80 x1874256847855104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430945.032877:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03dc6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430945.032939:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430945.032944:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847855232:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787430945.032950:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c079a1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430945.038283:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430945.038289:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430945.038292:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430945.038295:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430945.038309:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430945.038321:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787430945.038325:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2c079a1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430945.038332:0:9961:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 397 00000100:00080000:3.0:1787430945.038338:0:9961:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787430945.038343:0:9961:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e2c079a1000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430945.038363:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b19c00 x1874256847861760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430945.038375:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430945.038378:0:9961:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787430945.038379:0:9961:0:(import.c:65:import_set_state_nolock()) ffff8e2b03dc6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430945.038382:0:9961:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 397 00000100:00080000:3.0:1787430945.038385:0:9961:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787430945.038388:0:9961:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e2b03dc6800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430945.038396:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b18a80 x1874256847861888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787430945.038433:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847861632:0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.038497:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430945.038534:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787430945.038540:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847861248:0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.038581:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430945.038624:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847862016:0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.038652:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430945.038678:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847861376:0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.038702:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430945.038728:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430945.038736:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847861504:0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.038755:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430945.038784:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847861632 00000100:00100000:3.0:1787430945.038791:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847861632 00000100:00100000:3.0:1787430945.038828:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847861376 00000100:00100000:3.0:1787430945.038831:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847861376 00000100:00100000:3.0:1787430945.038848:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787430945.038857:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847861632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.038908:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847861632:12345-0@lo:400:kworker.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.038915:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787430945.038929:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430945.038935:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847861376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.038965:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847861376:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.038971:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430945.038987:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847861248 00000100:00100000:3.0:1787430945.038991:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847861248 00000100:00100000:3.0:1787430945.039015:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430945.039022:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:3627:x1874256847861248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.039048:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:3627:x1874256847861248:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.039054:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430945.039080:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862016 00000100:00100000:3.0:1787430945.039083:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862016 00000100:00100000:3.0:1787430945.039104:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847861504 00000100:00100000:3.0:1787430945.039107:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847861504 00000100:00100000:3.0:1787430945.039128:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430945.039134:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847862016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.039175:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847862016:12345-0@lo:400:kworker.0 Request processed in 41us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.039185:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430945.039197:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430945.039203:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847861504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.039228:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847861504:12345-0@lo:400:kworker.0 Request processed in 26us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.039234:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430945.039268:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847861248:0@lo:400:kworker.0 00010000:00080000:3.0:1787430945.039279:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2b03b1bb80 x1874256847862016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430945.039291:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847862016:0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.039298:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847861632:0@lo:400:kworker.0 00010000:00080000:3.0:1787430945.039322:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2b03b18700 x1874256847861504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430945.039331:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847861504:0@lo:400:kworker.0 00000100:00100000:3.0:1787430945.039338:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847861376:0@lo:400:kworker.0 00000100:00080000:2.0:1787430945.040312:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430945.040319:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847855104:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787430945.040351:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847861760:0@lo:8:kworker.0 00000400:00000100:2.0:1787430945.040383:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847861760 offset 0 length 520: 4 00000100:00100000:2.0:1787430945.040402:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847861888:0@lo:8:kworker.0 00000400:00000100:2.0:1787430945.040416:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256847861888 offset 0 length 520: 4 00000100:00080000:0.0:1787430945.040677:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430945.040682:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430945.040685:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430945.040688:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1787430945.106831:0:18618:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787430945.106835:0:18618:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787430945.106837:0:18618:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787430945.106967:0:18618:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2c35cb3800 00000020:01000004:0.0:1787430945.106983:0:18618:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787430945.106996:0:18618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787430945.107010:0:18618:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e2c3bd44d28) 00000020:00000080:0.0:1787430945.107027:0:18618:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787430945.160063:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787430945.161696:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787430945.161956:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787430945.162694:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787430945.162918:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787430945.163266:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787430945.163490:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1787430945.165554:0:18618:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787430945.165867:0:18618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787430945.165880:0:18618:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787430945.165892:0:18618:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4dbb683ba6a952e7 00000020:01000004:2.0:1787430945.165899:0:18618:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787430945.165923:0:18618:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787430945.165927:0:18618:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787430945.165933:0:18618:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787430945.165937:0:18618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787430945.165949:0:18618:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e2c35c4cd28) 00000020:00000080:2.0:1787430945.165960:0:18618:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787430945.167094:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430945.167269:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787430945.167275:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787430945.167952:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787430945.167959:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787430945.168281:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787430945.168288:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787430945.176276:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430945.176474:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787430945.176481:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787430945.177212:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787430945.177220:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787430945.192092:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430945.192335:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787430945.192341:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787430945.193948:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787430945.193962:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787430945.194756:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787430945.194763:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787430945.196316:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430945.196491:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787430945.196496:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787430945.197124:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787430945.197131:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787430945.223861:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430945.224094:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787430945.224101:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787430945.225109:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787430945.225118:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787430945.225718:0:18618:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787430945.225748:0:18618:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787430945.225755:0:18618:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787430945.248250:0:18618:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787430945.248300:0:18618:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787430945.248305:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787430945.248307:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430945.248308:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430945.248309:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430945.248310:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430945.248312:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430945.248314:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430945.248315:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430945.248317:0:18618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787430945.248321:0:18618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787430945.248323:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787430945.248324:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430945.248325:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430945.248326:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430945.248327:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430945.248329:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430945.248330:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430945.248331:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430945.248332:0:18618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787430945.248361:0:18618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787430945.248381:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787430945.248472:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.248569:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430945.248718:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862144 00000100:00100000:3.0:1787430945.248727:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862144 00000100:00100000:3.0:1787430945.248784:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787430945.248796:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:18618:x1874256847862144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787430945.248844:0:17114:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787430945.248848:0:17114:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787430945.248852:0:17114:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787430945.249447:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:18618:x1874256847862144:12345-0@lo:253:mount.lustre.0 Request processed in 652us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.249456:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787430945.249533:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787430945.249544:0:18618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787430945.249547:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430945.249549:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430945.249550:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430945.249551:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430945.249552:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430945.249553:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430945.249555:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430945.249556:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430945.249558:0:18618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787430945.249578:0:18618:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2c35cb3800 from lustre-OST0000 10000000:01000000:2.0:1787430945.249633:0:18618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787430945.249643:0:18618:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787430945.249650:0:18618:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e2b0355cd28 local copy 00010000:00010000:2.0:1787430945.249659:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430945.249833:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430945.249865:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.249932:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a7780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430945.249965:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862272 00000100:00100000:3.0:1787430945.249970:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862272 00000100:00100000:3.0:1787430945.250040:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787430945.250049:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:18618:x1874256847862272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430945.250120:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:18618:x1874256847862272:12345-0@lo:501:mount.lustre.0 Request processed in 72us (254us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430945.250137:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787430945.250201:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862272:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787430945.250215:0:18618:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787430945.250233:0:18618:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787430945.250238:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.250247:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430945.250273:0:18618:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2c35cb3800 10000000:01000000:2.0:1787430945.250278:0:18618:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787430945.250283:0:18618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787430945.250286:0:18618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430945.250290:0:18618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787430945.250293:0:18618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787430945.250314:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03200/0x4dbb683ba6a952f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.250321:0:18618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03200/0x4dbb683ba6a952f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.250343:0:18618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03200/0x4dbb683ba6a952f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430945.250357:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430945.250383:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.250493:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a7780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430945.250555:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862400 00000100:00100000:1.0:1787430945.250559:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862400 00000100:00100000:1.0:1787430945.250586:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787430945.250591:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+18:18618:x1874256847862400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430945.250631:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430945.250643:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4800/0x4dbb683ba6a952fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a952f5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.250664:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4800/0x4dbb683ba6a952fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a952f5 expref: 19 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.250674:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce4800/0x4dbb683ba6a952fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a952f5 expref: 19 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.250683:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4800, rc 0) 00000100:00100000:1.0:1787430945.250725:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862400:12345-0@lo:101:mount.lustre.0 Request processed in 134us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430945.250732:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787430945.250820:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430945.250831:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03200/0x4dbb683ba6a952f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952fc expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.250842:0:18618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03200/0x4dbb683ba6a952f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a952fc expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430945.254802:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787430945.256915:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430945.258563:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787430945.258657:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787430945.258675:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787430945.258956:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787430945.258978:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787430945.258991:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787430945.259015:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787430945.259020:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787430945.259207:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430945.259285:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430945.259399:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a644d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430945.259512:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862528 00000100:00100000:3.0:1787430945.259522:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862528 00000100:00100000:3.0:1787430945.259582:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787430945.259593:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430945.260154:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862528:12345-0@lo:501:mount.lustre.0 Request processed in 553us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.260163:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787430945.260274:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430945.260320:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430945.260359:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430945.260437:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a644d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.260470:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862656 00000100:00100000:0.0:1787430945.260475:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862656 00000100:00100000:0.0:1787430945.260545:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787430945.260554:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430945.261418:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862656:12345-0@lo:503:mount.lustre.0 Request processed in 864us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.261428:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787430945.261506:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787430945.262277:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430945.262376:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430945.262425:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430945.262509:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c328c9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787430945.262547:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862784 00000100:00100000:3.0:1787430945.262554:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862784 00000100:00100000:3.0:1787430945.263082:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787430945.263093:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430945.263795:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862784:12345-0@lo:502:mount.lustre.0 Request processed in 702us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.263815:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787430945.263907:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430945.264166:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787430945.264196:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787430945.264210:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787430945.264238:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787430945.264254:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787430945.264268:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787430945.264281:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787430945.264294:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787430945.264306:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787430945.264319:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787430945.264332:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787430945.264344:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787430945.264380:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430945.264434:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.268116:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.268245:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847862912 00000100:00100000:0.0:1787430945.268256:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847862912 00000100:00100000:0.0:1787430945.268312:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787430945.268322:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430945.268488:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847862912:12345-0@lo:502:mount.lustre.0 Request processed in 166us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.268496:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787430945.268635:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847862912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430945.268734:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787430945.268748:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787430945.269547:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787430945.269556:0:18635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787430945.269571:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.269573:0:18635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787430945.269578:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430945.269639:0:18635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e2b039a99b8) 00000020:00000080:0.0:1787430945.269661:0:18635:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787430945.269667:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787430945.269750:0:18635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c35cb3800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787430945.269758:0:18635:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787430945.269766:0:18635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4dbb683ba6a9530a 00010000:00010000:0.0:1787430945.272468:0:18635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787430945.273390:0:18635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1787430945.275053:0:18635:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787430945.276212:0:18635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787430945.276222:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430945.276229:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.276231:0:18635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787430945.276234:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787430945.276238:0:18635:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787430945.276239:0:18635:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787430945.276240:0:18635:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787430945.276242:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787430945.276244:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.276246:0:18635:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787430945.276248:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430945.276251:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.276253:0:18635:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787430945.276255:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787430945.276257:0:18635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787430945.276259:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430945.276261:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.276262:0:18635:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787430945.276264:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430945.276274:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.276275:0:18635:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787430945.276278:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787430945.276303:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430945.276306:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.276307:0:18635:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787430945.276311:0:18635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787430945.279963:0:18618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787430945.280012:0:18618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787430945.280080:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03200/0x4dbb683ba6a952f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952fc expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.280094:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03200/0x4dbb683ba6a952f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a952fc expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430945.280102:0:18618:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c35cb3800 from 1 10000000:01000000:2.0:1787430945.280105:0:18618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430945.280141:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.280160:0:18618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.280171:0:18618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430945.280199:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430945.280270:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.280316:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778840 going to sleep for 11 seconds 00000100:00100000:3.0:1787430945.282280:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863040 00000100:00100000:3.0:1787430945.282292:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863040 00000100:00100000:3.0:1787430945.282344:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430945.282354:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:18618:x1874256847863040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430945.282367:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430945.282382:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95311 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430945.282405:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430945.282416:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430945.282425:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8aa00, rc 0) 00000100:00100000:3.0:1787430945.282482:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863040:12345-0@lo:101:mount.lustre.0 Request processed in 130us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.282489:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787430945.282636:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430945.282661:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.282670:0:18618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430945.290504:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787430945.290923:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430945.291104:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787430945.291126:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787430945.291143:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787430945.291214:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787430945.291293:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430945.291361:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430945.291783:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a738cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430945.291891:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863168 00000100:00100000:1.0:1787430945.291899:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863168 00000100:00100000:1.0:1787430945.291950:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787430945.291960:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430945.292079:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863168:12345-0@lo:501:mount.lustre.0 Request processed in 119us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430945.292087:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787430945.292180:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430945.292212:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430945.292257:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.292282:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.292325:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863296 00000100:00100000:0.0:1787430945.292330:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863296 00000100:00100000:0.0:1787430945.292363:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787430945.292371:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430945.292434:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863296:12345-0@lo:503:mount.lustre.0 Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.292440:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787430945.292504:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787430945.292904:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430945.292956:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430945.292995:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.293014:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.295994:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863424 00000100:00100000:0.0:1787430945.296010:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863424 00000100:00100000:0.0:1787430945.296078:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787430945.296089:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430945.296274:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863424:12345-0@lo:502:mount.lustre.0 Request processed in 187us (3277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.296293:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787430945.296403:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430945.296681:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787430945.296723:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787430945.296738:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787430945.296753:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787430945.296767:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787430945.296781:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787430945.296809:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787430945.296824:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787430945.296836:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787430945.296849:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787430945.296863:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787430945.296913:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430945.296958:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.296981:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a778480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.297108:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863552 00000100:00100000:0.0:1787430945.297113:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863552 00000100:00100000:0.0:1787430945.297155:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787430945.297163:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430945.297241:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863552:12345-0@lo:502:mount.lustre.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.297248:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787430945.297322:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430945.297360:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787430945.297368:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787430945.298256:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430945.298267:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.298270:0:18639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787430945.298277:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c35cb3800 00000020:00000080:0.0:1787430945.298280:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787430945.298287:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430945.298289:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.298291:0:18639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787430945.298293:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430945.298295:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.298297:0:18639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787430945.298300:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2c35cb3800 00000020:00000080:0.0:1787430945.298302:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787430945.298398:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430945.298402:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.298404:0:18639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787430945.298407:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430945.298410:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.298411:0:18639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787430945.298414:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c35cb3800 00000020:00000080:0.0:1787430945.298416:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787430945.307811:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430945.307904:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.307907:0:18639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787430945.307913:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430945.307918:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.307919:0:18639:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787430945.307925:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2c35cb3800 00000020:00000080:0.0:1787430945.307927:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787430945.307995:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430945.307999:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430945.308001:0:18639:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787430945.308004:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787430945.315731:0:18618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787430945.315782:0:18618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430945.315810:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.315823:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430945.315882:0:18618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787430945.315886:0:18618:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2c35cb3800 10000000:01000000:2.0:1787430945.315889:0:18618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2c35cb3800 10000000:01000000:2.0:1787430945.315892:0:18618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430945.315898:0:18618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2c35cb3800 from 1 10000000:01000000:2.0:1787430945.315901:0:18618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787430945.315935:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a9531f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.315944:0:18618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a9531f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.315955:0:18618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a9531f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430945.315978:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430945.316049:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.316082:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c130616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.316153:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863680 00000100:00100000:0.0:1787430945.316160:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863680 00000100:00100000:0.0:1787430945.316211:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787430945.316221:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:18618:x1874256847863680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430945.316235:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430945.316247:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42175800/0x4dbb683ba6a95326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9531f expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.316270:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42175800/0x4dbb683ba6a95326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9531f expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.316280:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42175800/0x4dbb683ba6a95326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9531f expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.316289:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175800, rc 0) 00000100:00100000:0.0:1787430945.316325:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847863680:12345-0@lo:101:mount.lustre.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.316332:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787430945.316500:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430945.316514:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a9531f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95326 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.316523:0:18618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a9531f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95326 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430945.317721:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787430945.317946:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430945.318091:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787430945.318111:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787430945.318122:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787430945.318132:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787430945.318142:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787430945.318167:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787430945.318177:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787430945.318188:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787430945.318198:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787430945.318209:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787430945.318219:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787430945.318229:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787430945.318240:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787430945.318250:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787430945.318260:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787430945.318271:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787430945.318291:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787430945.318303:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787430945.318313:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787430945.318324:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787430945.318340:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787430945.318350:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787430945.318361:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787430945.318371:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787430945.318382:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787430945.318392:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787430945.318402:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787430945.318412:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787430945.318423:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787430945.318433:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787430945.318443:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787430945.318453:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787430945.318473:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787430945.318484:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787430945.318494:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787430945.318505:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787430945.318515:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787430945.318529:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787430945.318533:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787430945.318709:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430945.318762:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.318826:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e5ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.318904:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863808 00000100:00100000:0.0:1787430945.318910:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863808 00000100:00100000:0.0:1787430945.318950:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430945.318959:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847863808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430945.319056:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847863808:12345-0@lo:501:mount.lustre.0 Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.319063:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787430945.319129:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430945.319165:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430945.319198:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.319218:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847863936 00000100:00100000:2.0:1787430945.319221:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847863936 00000100:00100000:2.0:1787430945.319248:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787430945.319255:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847863936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430945.319317:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847863936:12345-0@lo:503:mount.lustre.0 Request processed in 63us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430945.319323:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787430945.319350:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430945.319360:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847863936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787430945.319774:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430945.319815:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430945.319845:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.319864:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04e5ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.320162:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864064 00000100:00100000:0.0:1787430945.320167:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864064 00000100:00100000:0.0:1787430945.320208:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787430945.320215:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430945.320297:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864064:12345-0@lo:502:mount.lustre.0 Request processed in 82us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.320304:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787430945.320687:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787430945.320889:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787430945.320917:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787430945.320930:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787430945.320943:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787430945.320956:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787430945.320969:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787430945.320982:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787430945.320994:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787430945.321015:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787430945.321027:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787430945.321040:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787430945.321051:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787430945.321062:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787430945.321074:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787430945.321087:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787430945.321100:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787430945.321129:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787430945.321156:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787430945.321170:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787430945.321182:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787430945.321195:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787430945.321208:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787430945.321220:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787430945.321233:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787430945.321245:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787430945.321257:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787430945.321269:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787430945.321280:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787430945.321292:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787430945.321304:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787430945.321317:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787430945.321330:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787430945.321357:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787430945.321373:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787430945.321385:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787430945.321397:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787430945.321410:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787430945.321421:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787430945.321432:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787430945.321443:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787430945.321455:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787430945.321475:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787430945.321486:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787430945.321498:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787430945.321510:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787430945.321523:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787430945.321537:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787430945.321548:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787430945.322808:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430945.322882:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430945.322998:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fe9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.330650:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864192 00000100:00100000:0.0:1787430945.330666:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864192 00000100:00100000:3.0:1787430945.331136:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787430945.331159:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430945.331467:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864192:12345-0@lo:502:mount.lustre.0 Request processed in 320us (8583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.331476:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430945.332538:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430945.333221:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787430945.333252:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787430945.333289:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430945.333347:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430945.333384:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a738600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430945.334695:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864320 00000100:00100000:3.0:1787430945.334713:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864320 00000100:00100000:3.0:1787430945.334765:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787430945.334776:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430945.334902:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864320:12345-0@lo:502:mount.lustre.0 Request processed in 128us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.334910:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787430945.337005:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430945.337099:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787430945.337114:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787430945.338736:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787430945.338752:0:18644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e2b0362cd28) 00000020:00000080:3.0:1787430945.338774:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787430945.338859:0:18644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c35cb3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787430945.338863:0:18644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c35cb3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787430945.338865:0:18644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c35cb3800 3 00010000:00080000:3.0:1787430945.338904:0:18644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b0285f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1787430945.340472:0:18644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787430945.340687:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787430945.340724:0:18644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787430945.340734:0:18644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4dbb683ba6a95334 00000100:00080000:3.0:1787430945.340743:0:18644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430945.340748:0:18644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e2b0285f000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430945.340781:0:18644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b18700 x1874256847864448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430945.340801:0:18644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787430945.341174:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847864448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787430945.341241:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430945.342037:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864448 00000100:00100000:2.0:1787430945.342045:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864448 00000100:00100000:2.0:1787430945.342072:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787430945.342080:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847864448:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787430945.342102:0:17120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:2.0:1787430945.342143:0:17120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4dbb683ba6a9533b 00000004:00100000:2.0:1787430945.342959:0:17120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787430945.342994:0:17120:0:(import.c:65:import_set_state_nolock()) ffff8e2b0375a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430945.343059:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874256847864448:12345-0@lo:38:llog_process_th.0 Request processed in 979us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430945.343066:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787430945.343218:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2b03b18700 x1874256847864448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430945.343231:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787430945.343248:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787430945.343256:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787430945.343260:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787430945.343262:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0285f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787430945.343268:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1874256847864448:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787430945.345160:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430945.345168:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430945.345171:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430945.345174:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:2.0:1787430945.352213:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787430945.352236:0:18644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e2c35c48000) 00000020:00000080:2.0:1787430945.352264:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787430945.352358:0:18644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2c35cb3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787430945.352362:0:18644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2c35cb3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787430945.352364:0:18644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2c35cb3800 3 00010000:00080000:2.0:1787430945.352396:0:18644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b0375c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1787430945.366965:0:18644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787430945.367231:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787430945.367281:0:18644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787430945.367294:0:18644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4dbb683ba6a95349 00000100:00080000:3.0:1787430945.367305:0:18644:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430945.367312:0:18644:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e2b0375c800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430945.367347:0:18644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b1b100 x1874256847864576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430945.367372:0:18644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787430945.367540:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430945.367546:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430945.367549:0:9961:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430945.367553:0:9961:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787430945.368048:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1874256847864576:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787430945.368124:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430945.368238:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864576 00000100:00100000:0.0:1787430945.368245:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864576 00000100:00100000:0.0:1787430945.368283:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430945.368291:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1874256847864576:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787430945.368316:0:17122:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:0.0:1787430945.368345:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4dbb683ba6a95350 00000004:00100000:0.0:1787430945.368360:0:17122:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787430945.368393:0:17122:0:(import.c:65:import_set_state_nolock()) ffff8e2b02bc7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430945.368443:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1874256847864576:12345-0@lo:38:llog_process_th.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430945.368449:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787430945.368487:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2b03b1b100 x1874256847864576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430945.368497:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430945.368504:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787430945.368511:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787430945.368515:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787430945.368518:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b0375c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787430945.368524:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1874256847864576:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787430945.370234:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787430945.370350:0:18618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787430945.370395:0:18618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430945.370412:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a9531f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95326 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.370423:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02000/0x4dbb683ba6a9531f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95326 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787430945.370467:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787430945.370469:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787430945.370470:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430945.370471:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430945.370472:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430945.370473:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430945.370475:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430945.370477:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430945.370478:0:18618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430945.370481:0:18618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787430945.370483:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430945.370485:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787430945.370485:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430945.370486:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430945.370487:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430945.370488:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430945.370489:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430945.370490:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430945.370491:0:18618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430945.370512:0:18618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787430945.370530:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864704:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787430945.370593:0:18618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430945.370637:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c18aeb540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430945.370658:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864704 00000100:00100000:0.0:1787430945.370662:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864704 00000100:00100000:0.0:1787430945.370713:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787430945.370720:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430945.370749:0:17115:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787430945.370762:0:17115:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787430945.378865:0:17115:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787430945.378899:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787430945.379233:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:18618:x1874256847864704:12345-0@lo:253:mount.lustre.0 Request processed in 8507us (8634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430945.379246:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:2.0:1787430945.379298:0:17136:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787430945.379302:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787430945.379319:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.379330:0:17136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.379336:0:17136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 20 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.379341:0:17136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.379372:0:17136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 20 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.379381:0:17136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 20 pid: 17115 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430945.379400:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847864832:0@lo:104: 00000100:00100000:2.0:1787430945.379428:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430945.379490:0:17136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430945.379496:0:17136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 20 pid: 17112 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430945.379501:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847864960:0@lo:104: 00000100:00100000:2.0:1787430945.379517:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430945.379547:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:18618:1874256847864704:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787430945.379557:0:18618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787430945.379566:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787430945.379568:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787430945.379568:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430945.379569:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430945.379570:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430945.379571:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430945.379572:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430945.379574:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430945.379575:0:18618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787430945.379586:0:18618:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787430945.381033:0:17136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a761f00 going to sleep for 11 seconds 00000001:00000004:0.0:1787430945.381192:0:18618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787430945.382424:0:17103:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787430945.382424:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864832 00000100:00100000:1.0:1787430945.382434:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864832 00000100:00100000:3.0:1787430945.382447:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847864960 00000100:00100000:3.0:1787430945.382450:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847864960 00000100:00100000:3.0:1787430945.382861:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430945.382875:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:17136:x1874256847864960:12345-0@lo:104: 00010000:00010000:3.0:1787430945.382900:0:17103:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430945.383028:0:17103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430945.383035:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:17136:x1874256847864960:12345-0@lo:104: Request processed in 164us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.383043:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430945.383061:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430945.383069:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847864832:12345-0@lo:104: 00010000:00010000:3.0:1787430945.383077:0:17103:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430945.383095:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847864960:0@lo:104: 00000100:00100000:1.0:1787430945.383104:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847864832:0@lo:104: 00010000:00010000:0.0:1787430945.383206:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430945.383213:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383221:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430945.383226:0:17108:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383234:0:17108:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430945.383241:0:17108:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430945.383247:0:17108:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430945.383272:0:17136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383283:0:17108:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383295:0:17108:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430945.383322:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383330:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a400/0x4dbb683ba6a9529a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952a1 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383342:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430945.383345:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383351:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5200 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:0.0:1787430945.383354:0:17108:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383361:0:17108:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430945.383368:0:17108:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430945.383373:0:17108:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430945.383473:0:17108:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383479:0:17108:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430945.383487:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383493:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5200/0x4dbb683ba6a952a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952af expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430945.383513:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430945.383514:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430945.383516:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430945.383536:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847865216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430945.383652:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430945.383696:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430945.383758:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847865088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430945.383785:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430945.383940:0:17103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787430945.383947:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847864832:12345-0@lo:104: Request processed in 878us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.383955:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787430945.384090:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430945.384093:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865216 00000100:00100000:1.0:1787430945.384102:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865216 00010000:00010000:1.0:1787430945.384224:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 21 pid: 17115 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430945.384255:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865088 00000100:00100000:1.0:1787430945.384259:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865088 00000100:00100000:3.0:1787430945.384272:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787430945.384273:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 22 pid: 17112 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430945.384279:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:3630:x1874256847865216:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430945.384284:0:17105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1787430945.384289:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787430945.384290:0:17105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787430945.384295:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 22 pid: 17115 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430945.384307:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 22 pid: 17115 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430945.384312:0:17106:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1787430945.384321:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8b400/0x4dbb683ba6a952af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a952a8 expref: 22 pid: 17115 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430945.384328:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430945.384335:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36177850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:3630:x1874256847865088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430945.384341:0:17106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430945.384342:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430945.384345:0:17106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 21 pid: 17112 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384354:0:17106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 21 pid: 17112 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384364:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a952a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a9529a expref: 21 pid: 17112 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384375:0:17106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430945.384377:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:3630:x1874256847865216:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430945.384383:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787430945.384383:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787430945.384395:0:17106:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005093519s 00010000:00010000:1.0:1787430945.384400:0:17106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384414:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384421:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384427:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384432:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:1.0:1787430945.384437:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384443:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384465:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430945.384473:0:17106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430945.384498:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36177850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:3630:x1874256847865088:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430945.384505:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787430945.384589:0:17136:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430945.384597:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430945.384631:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35f03000/0x4dbb683ba6a95357 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430945.388494:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847865088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430945.388511:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847865216:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1787430945.389483:0:18618:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787430945.389496:0:18618:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787430945.389531:0:18618:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787430945.389573:0:18618:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787430945.389595:0:18618:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787430945.389860:0:18618:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787430945.394419:0:18618:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430945.394680:0:18618:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787430945.919803:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787430946.046059:0:18699:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430946.046302:0:18699:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787430946.049896:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847865344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430946.049973:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430946.051084:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865344 00000100:00100000:2.0:1787430946.051097:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865344 00000100:00100000:2.0:1787430946.051187:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430946.051199:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847865344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787430946.051238:0:17126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787430946.051307:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847865344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430946.051314:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787430946.051596:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847865472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430946.051655:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430946.052049:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865472 00000100:00100000:0.0:1787430946.052055:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865472 00000100:00100000:0.0:1787430946.052079:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430946.052087:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847865472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787430946.052107:0:17125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787430946.053622:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847865472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1511us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430946.053634:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430946.053699:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847865344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430946.053926:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847865472:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1787430946.561676:0:17851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:2.0:1787430946.752696:0:17117:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787430946.752703:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c08afe800 from 9 10000000:01000000:2.0:1787430946.752708:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787430946.752754:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430946.752779:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430946.752790:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430946.752817:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430946.752885:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430946.752930:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1af33600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430946.753031:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865600 00000100:00100000:0.0:1787430946.753040:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865600 00000100:00100000:0.0:1787430946.753109:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787430946.753120:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+19:17117:x1874256847865600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430946.753141:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430946.753155:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9535e expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430946.753177:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430946.753187:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430946.753197:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174000, rc 0) 00000100:00100000:0.0:1787430946.753241:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:17117:x1874256847865600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430946.753248:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787430946.753667:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430946.753681:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430946.753690:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430946.753743:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787430946.753776:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430946.753799:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1af33600 going to sleep for 11 seconds 00000100:00100000:1.0:1787430946.753843:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865728 00000100:00100000:1.0:1787430946.753848:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865728 00000100:00100000:1.0:1787430946.753878:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787430946.753887:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:17117:x1874256847865728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787430946.753901:0:17115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430946.753917:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430946.753920:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787430946.754013:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787430946.754013:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:17117:x1874256847865728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430946.754020:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 10000000:01000000:2.0:1787430946.754081:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787430946.754088:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430946.754096:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430946.754115:0:17117:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787430946.754117:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a7800 from 9 10000000:01000000:2.0:1787430946.754120:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787430946.754145:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430946.754153:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430946.754161:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430946.754173:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430946.754197:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430946.754220:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b8f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430946.754233:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865856 00000100:00100000:1.0:1787430946.754237:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865856 00000100:00100000:1.0:1787430946.754270:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787430946.754278:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:17117:x1874256847865856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430946.754286:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430946.754305:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9536c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430946.754321:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430946.754330:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430946.754336:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4200, rc 0) 00000100:00100000:1.0:1787430946.754373:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847865856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430946.754384:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787430946.754446:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430946.754456:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430946.754463:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430946.754501:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787430946.754529:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430946.754569:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430946.755157:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847865984 00000100:00100000:1.0:1787430946.755163:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847865984 00000100:00100000:1.0:1787430946.755197:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787430946.755205:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847865984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787430946.755218:0:17114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430946.755231:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430946.755234:0:17114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787430946.755315:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847865984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430946.755322:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787430946.756360:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847865984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787430946.756425:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787430946.756434:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430946.756444:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430946.945471:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787430947.084845:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787430947.265989:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787430947.976008:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430948.991871:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430949.543337:0:18989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787430950.015806:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787430950.102312:0:19041:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430950.102476:0:19041:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787430950.529003:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430935/real 1787430935] req@ffff8e2b04ac0700 x1874256847853184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430950 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.529027:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b04ac0700 x1874256847853184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430950 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.529035:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430935/real 1787430935] req@ffff8e2b04ac2680 x1874256847853312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430950 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.529042:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b04ac2680 x1874256847853312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430950 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787430950.529057:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a676800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430950.529207:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787430950.529212:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847853184:0@lo:8:kworker.0 00000100:00080000:3.0:1787430950.529224:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430950.529229:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787430950.529231:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847853312:0@lo:8:kworker.0 00000100:00100000:3.0:1787430950.529704:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430950.529716:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847866112:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.529766:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787430950.529858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430950.529862:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787430950.529864:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a676800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430950.529868:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:3.0:1787430950.529871:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787430950.529876:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2c3a676800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430950.529889:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b19500 x1874256847866368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430950.529898:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430950.529900:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787430950.529901:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430950.529903:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:3.0:1787430950.529905:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787430950.529906:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2c31563000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1787430950.529911:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03b19180 x1874256847866496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430950.529930:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430950.529941:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787430950.529947:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430950.529949:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787430950.529973:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847866624:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.529994:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430950.530007:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847867136:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530031:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430950.530043:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430950.530046:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847866752:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530059:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430950.530088:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847866624 00000100:00100000:3.0:1787430950.530109:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847866624 00000100:00100000:3.0:1787430950.530167:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867136 00000100:00100000:3.0:1787430950.530170:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867136 00000100:00100000:3.0:1787430950.530197:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430950.530206:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847866624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530263:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847866624:12345-0@lo:400:kworker.0 Request processed in 57us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430950.530269:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430950.530282:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430950.530286:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847867136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530303:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1874256847867136:12345-0@lo:400:kworker.0 Request processed in 17us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430950.530307:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787430950.530337:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787430950.530353:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03b18000 x1874256847866624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.530370:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847866624:0@lo:400:kworker.0 00010000:00080000:3.0:1787430950.530378:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b0483f100 x1874256847867136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.530383:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1874256847867136:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530396:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847866240:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530410:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430950.530421:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847867008:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530434:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430950.530442:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430950.530445:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847866880:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530454:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430950.530466:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847866752 00000100:00100000:3.0:1787430950.530468:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847866752 00000100:00100000:3.0:1787430950.530481:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847866240 00000100:00100000:3.0:1787430950.530483:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847866240 00000100:00100000:3.0:1787430950.530491:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430950.530505:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847866752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530533:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847866752:12345-0@lo:400:kworker.0 Request processed in 39us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430950.530537:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430950.530545:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787430950.530548:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847866240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530564:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847866240:12345-0@lo:400:kworker.0 Request processed in 17us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430950.530575:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787430950.530587:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867008 00000100:00100000:3.0:1787430950.530590:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867008 00000100:00100000:3.0:1787430950.530620:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847866880 00000100:00100000:3.0:1787430950.530622:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847866880 00000100:00100000:3.0:1787430950.530630:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430950.530633:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847867008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530652:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847867008:12345-0@lo:400:kworker.0 Request processed in 19us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430950.530655:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430950.530661:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430950.530664:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847866880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530677:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874256847866880:12345-0@lo:400:kworker.0 Request processed in 12us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430950.530680:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787430950.530688:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430950.530697:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847866752:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530708:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847866368:0@lo:8:kworker.0 00000100:00100000:3.0:1787430950.530725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430950.530740:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847866496:0@lo:8:kworker.0 00000100:00100000:3.0:1787430950.530752:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787430950.530770:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03b18700 x1874256847866880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.530775:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874256847866880:0@lo:400:kworker.0 00000100:00100000:3.0:1787430950.530780:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847866240:0@lo:400:kworker.0 00010000:00080000:3.0:1787430950.530792:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03b1b480 x1874256847867008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.530796:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847867008:0@lo:400:kworker.0 00000100:00100000:1.0:1787430950.530874:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847866368 00000100:00100000:1.0:1787430950.530879:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847866368 00000100:00100000:1.0:1787430950.530902:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847866496 00000100:00100000:1.0:1787430950.530905:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847866496 00000100:00100000:1.0:1787430950.530916:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430950.530921:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1874256847866368:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787430950.530944:0:18622:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:1.0:1787430950.530976:0:18622:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a9537a 00002000:00100000:1.0:1787430950.530989:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e2b03dc5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787430950.530993:0:18622:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787430950.530995:0:18622:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787430950.531168:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787430950.531195:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8e2c079a2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430950.531236:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1874256847866368:12345-0@lo:8:kworker.0 Request processed in 313us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430950.531243:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430950.531256:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430950.531261:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1874256847866496:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787430950.531273:0:18622:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787430950.533869:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03b19500 x1874256847866368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430950.533885:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430950.533894:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787430950.533903:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787430950.533910:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787430950.533913:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a676800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787430950.533938:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787430950.533944:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847866368:0@lo:8:kworker.0 00000100:00100000:2.0:1787430950.534810:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847866112 00000100:00100000:2.0:1787430950.534819:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847866112 00000004:00080000:2.0:1787430950.534869:0:17145:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1787430950.534887:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17145:1874256847867392:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787430950.535003:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847867264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430950.535029:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430950.535076:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867264 00000100:00100000:0.0:1787430950.535081:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867264 00000100:00100000:0.0:1787430950.535192:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430950.535195:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430950.535205:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847867264:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430950.535217:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1842c300 going to sleep for 11 seconds 00002000:00000024:0.0:1787430950.535235:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787430950.535283:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1874256847867264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430950.535290:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787430950.535328:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430950.535347:0:18624:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787430950.535353:0:18624:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787430950.535736:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867392 00000100:00100000:3.0:1787430950.535741:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867392 00010000:00080000:3.0:1787430950.535781:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03d89880 x1874256847867264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430950.535798:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847867264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430950.536086:0:19072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430950.536104:0:19072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17145:x1874256847867392:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787430950.536546:0:18623:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787430950.536552:0:18623:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:2.0:1787430950.536569:0:17144:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787430950.536655:0:17144:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412009052717ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787430950.536659:0:17144:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787430950.536717:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787430950.536722:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:3630:x1874256847866112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430950.536765:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:3630:x1874256847866112:12345-0@lo:400:kworker.0 Request processed in 44us (6999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430950.536770:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787430950.537021:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847866112:0@lo:400:kworker.0 00000004:00080000:3.0:1787430950.540373:0:17100:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1787430950.540703:0:19072:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787430950.540710:0:19072:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787430950.540722:0:19072:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:1.0:1787430950.543487:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1874256847866496:12345-0@lo:8:kworker.0 Request processed in 12218us (12726us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787430950.543498:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787430950.543537:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430950.543543:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787430950.543546:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847866496:0@lo:8:kworker.0 00002000:00010000:1.0:1787430950.548757:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.548770:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.548788:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.548792:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.548799:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.548829:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.548840:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.548848:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.548883:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.548931:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.548938:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.548946:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.548951:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.548960:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.548978:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.548986:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c89b161b/0x4dbb683ba6a95381 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.549003:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.549005:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.549007:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.549313:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.549317:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549323:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.549325:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.549328:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549334:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549340:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549348:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549367:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.549411:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.549416:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.549424:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5a00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.549428:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.549442:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.549453:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.549460:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afcafd34/0x4dbb683ba6a95388 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.549474:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.549476:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.549478:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.549574:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.549757:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549766:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.549775:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.549780:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549790:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549798:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549816:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.549835:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.549845:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.549851:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.549857:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5e00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.549860:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.549866:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.549877:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.549883:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d4fd4c3/0x4dbb683ba6a9538f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.549901:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.549902:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.549904:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.550136:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.550142:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550151:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.550154:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.550158:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550167:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550175:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550189:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550205:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.550220:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.550224:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.550230:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.550233:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.550239:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.550247:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.550261:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feb9854c/0x4dbb683ba6a95396 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.550271:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.550272:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.550274:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.550928:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.550934:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550943:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.550946:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.550950:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550959:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550967:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550975:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.550996:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.551046:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.551052:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.551061:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.551064:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.551073:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.551084:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.551092:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aee138ea/0x4dbb683ba6a9539d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.551118:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.551120:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.551123:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.551424:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.551428:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551439:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.551441:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.551443:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551450:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551454:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551459:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551501:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.551739:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.551745:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.551752:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.551755:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.551763:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.551773:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.551781:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da8f6ec/0x4dbb683ba6a953a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.551801:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.551802:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.551848:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787430950.551849:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430950.551853:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551861:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.551864:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.551866:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551872:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551887:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551891:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.551902:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.551923:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.551927:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.551945:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4c00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.552011:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552073:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552087:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552094:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b72e55/0x4dbb683ba6a953ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552118:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.552119:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.552121:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.552167:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.552171:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552176:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.552178:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.552181:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552186:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552191:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552196:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552216:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.552397:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.552402:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.552410:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efc00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.552413:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.552422:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.552432:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.552436:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daeb3583/0x4dbb683ba6a953b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.552446:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.552447:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.552448:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.552638:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.552644:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552652:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.552655:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.552659:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552668:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552675:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552682:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.552699:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.552706:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.552713:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552723:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.552727:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552737:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552756:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552764:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084276bb2/0x4dbb683ba6a953b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.552780:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.552782:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.552784:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.553022:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.553027:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553035:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.553044:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.553048:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553057:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553066:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553073:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553121:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430950.553361:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.553367:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553375:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.553378:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.553382:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553392:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553400:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.553413:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553454:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430950.553459:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553466:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eec00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.553470:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553488:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553510:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553687:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdbd6cd2/0x4dbb683ba6a953c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553702:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.553705:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553711:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.553714:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553722:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553732:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.553739:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.553741:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.553748:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430950.553794:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787430950.553799:0:19072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a953c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430950.554245:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.554249:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554256:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.554258:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.554261:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554267:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554272:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554276:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554318:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430950.554640:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.554647:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554656:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.554659:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.554662:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554671:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554679:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.554687:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554810:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430950.554815:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554820:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.554822:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554827:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554834:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554838:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a953ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554846:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.554848:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554852:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.554854:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554858:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554869:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.554873:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.554875:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.554876:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.555006:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430950.555033:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787430950.555039:0:19072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a953d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430950.555314:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.555318:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.555328:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.555330:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.555333:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.555341:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.555349:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.555356:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.555650:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.555655:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.555663:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eee00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.555666:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.555674:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.555685:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.555694:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.555695:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.555697:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.555736:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430950.555780:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787430950.555786:0:19072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a953dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430950.556064:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.556070:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556078:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.556081:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.556085:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556176:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556184:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556192:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556239:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.556329:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.556333:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.556350:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.556353:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.556360:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.556371:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.556378:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be5bc062/0x4dbb683ba6a953e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.556393:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.556394:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.556396:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.556465:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.556470:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556478:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.556481:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.556486:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556505:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556513:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556532:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556552:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.556571:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.556577:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.556583:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.556586:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.556592:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.556625:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.556630:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b817c2ee/0x4dbb683ba6a953ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.556646:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.556647:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.556648:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.556857:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.556863:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556871:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.556875:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.556879:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556887:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556895:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556901:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.556916:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.557177:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.557180:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557186:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.557188:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557193:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557205:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557210:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcca50a2/0x4dbb683ba6a953f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557218:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.557219:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.557219:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.557436:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.557440:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557450:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.557452:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.557454:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557460:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557465:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557470:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557481:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.557511:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.557524:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.557532:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efe00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.557537:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.557546:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.557558:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.557566:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008704bc4d/0x4dbb683ba6a953f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.557582:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.557584:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.557586:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.557784:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.557791:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557799:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.557854:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.557859:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557866:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557879:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557884:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.557897:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.557973:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.557976:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557981:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efa00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.557983:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557988:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.557996:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.558000:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cce6df77/0x4dbb683ba6a953ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.558020:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.558022:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.558024:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.559691:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.559702:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.559715:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.559718:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.559723:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.559734:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.559744:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.559751:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.559785:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.559797:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.559803:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.559818:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.559821:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.559828:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.559838:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.559843:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.559855:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.559856:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.559857:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.560118:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.560124:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560133:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.560135:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.560139:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560149:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560264:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560274:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560342:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.560451:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.560457:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.560465:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.560468:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.560476:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.560487:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.560557:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000089991a7/0x4dbb683ba6a9540d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.560573:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.560575:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.560577:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.560887:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.560893:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560900:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.560907:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.560910:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560916:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560921:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560925:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.560936:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.560957:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.560962:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.560968:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.560971:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.560977:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.560991:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.560996:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001188a021/0x4dbb683ba6a95414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.561006:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.561007:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.561008:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.561282:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.561286:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561291:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.561293:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.561296:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561301:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561306:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561315:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561328:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.561409:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.561413:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.561426:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.561429:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.561433:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.561440:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.561444:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb173c7/0x4dbb683ba6a9541b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.561453:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.561454:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.561455:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.561590:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.561595:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561671:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.561674:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.561679:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561689:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561697:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561705:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.561721:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.561734:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.561739:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.561745:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eea00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.561748:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.561753:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.561760:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.561765:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.561784:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.561785:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.561787:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.561992:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.561998:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562013:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.562016:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.562020:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562028:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562035:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562042:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562060:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430950.562224:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.562229:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.562236:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.562239:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.562246:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.562260:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.562267:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009443932f/0x4dbb683ba6a95429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.562279:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.562281:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.562283:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.562475:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.562479:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562485:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.562487:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.562490:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562545:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562558:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562565:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562580:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430950.562595:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430950.562624:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.562630:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430950.562632:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.562638:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.562646:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.562651:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b99ffdda/0x4dbb683ba6a95430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430950.562662:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.562664:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430950.562665:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430950.562871:0:19072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430950.562877:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562885:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1787430950.562888:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430950.562892:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562901:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562908:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562916:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430950.562964:0:19072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787430950.562988:0:19072:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1787430950.563081:0:19072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17145:x1874256847867392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26984us (27886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430950.563111:0:19072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787430950.563120:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17145:1874256847867392:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787430950.563137:0:17145:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1787430950.563191:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17145:1874256847867520:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787430950.563228:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430950.563259:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1842c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430950.563302:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867520 00000100:00100000:3.0:1787430950.563307:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867520 00010000:00010000:0.0:1787430950.563324:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430950.563328:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.563334:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eee00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:0.0:1787430950.563337:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.563342:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430950.563351:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430950.563356:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787430950.563361:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430950.563369:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17145:x1874256847867520:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1787430950.563388:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.563389:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430950.563390:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787430950.563412:0:18624:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1787430950.567761:0:18619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787430950.567801:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787430950.568144:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17145:x1874256847867520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4772us (4911us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787430950.568154:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787430950.570943:0:17145:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787430950.570956:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17145:1874256847867520:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787430950.570970:0:17145:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:3.0:1787430950.694063:0:19093:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787430950.694252:0:19093:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787430951.039769:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430951.167817:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430951.167839:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847867648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430951.167899:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430951.168668:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847867776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787430951.168803:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430951.171460:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867648 00000100:00100000:3.0:1787430951.171473:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867648 00000100:00100000:3.0:1787430951.171525:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867776 00000100:00100000:3.0:1787430951.171529:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867776 00000100:00100000:3.0:1787430951.171546:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787430951.171555:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847867648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430951.171589:0:17125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787430951.171673:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847867648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430951.171681:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787430951.171698:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430951.171705:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847867776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430951.171740:0:17125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787430951.171769:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847867776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430951.171788:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430951.171837:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847867776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430951.171851:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847867648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787430952.063846:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430953.087691:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430954.111825:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430955.136776:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787430955.263522:0:19438:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787430955.263526:0:19438:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787430955.263527:0:19438:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787430955.263673:0:19438:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2b0285b800 00000020:01000004:3.0:1787430955.263689:0:19438:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787430955.263703:0:19438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787430955.263716:0:19438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e2b0362b370) 00000020:00000080:3.0:1787430955.263735:0:19438:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787430955.328402:0:19438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787430955.330001:0:19438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787430955.330334:0:19438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787430955.330677:0:19438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787430955.330900:0:19438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787430955.331347:0:19438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787430955.331671:0:19438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1787430955.341108:0:19438:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787430955.341309:0:19438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787430955.341323:0:19438:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787430955.341335:0:19438:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4dbb683ba6a95445 00000020:01000004:1.0:1787430955.341341:0:19438:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787430955.341362:0:19438:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787430955.341366:0:19438:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787430955.341372:0:19438:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787430955.341400:0:19438:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787430955.341404:0:19438:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787430955.364232:0:19438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787430955.364272:0:19438:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787430955.364276:0:19438:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787430955.364278:0:19438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430955.364280:0:19438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430955.364281:0:19438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430955.364282:0:19438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430955.364283:0:19438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430955.364285:0:19438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430955.364287:0:19438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430955.364288:0:19438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430955.364292:0:19438:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787430955.364295:0:19438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787430955.364296:0:19438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430955.364297:0:19438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430955.364298:0:19438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430955.364299:0:19438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430955.364300:0:19438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430955.364301:0:19438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430955.364302:0:19438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430955.364303:0:19438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430955.364328:0:19438:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787430955.364349:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847867904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787430955.364432:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.364583:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847867904 00000100:00100000:0.0:1787430955.364591:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847867904 00000100:00100000:0.0:1787430955.364672:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787430955.364682:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:19438:x1874256847867904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430955.364723:0:17112:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787430955.364727:0:17112:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787430955.364731:0:17112:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787430955.365120:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:19438:x1874256847867904:12345-0@lo:253:mount.lustre.0 Request processed in 439us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.365129:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787430955.365212:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430955.365236:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847867904:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787430955.365247:0:19438:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787430955.365250:0:19438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787430955.365251:0:19438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430955.365252:0:19438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430955.365253:0:19438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430955.365255:0:19438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430955.365256:0:19438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430955.365257:0:19438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430955.365259:0:19438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430955.365260:0:19438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787430955.365286:0:19438:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2b0285b800 from lustre-OST0001 10000000:01000000:3.0:1787430955.365313:0:19438:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787430955.365315:0:19438:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787430955.365325:0:19438:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e2b0355cd28 local copy 00010000:00010000:3.0:1787430955.365338:0:19438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.365426:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430955.365454:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.365542:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c053490c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430955.365551:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868032 00000100:00100000:2.0:1787430955.365571:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868032 00000100:00100000:2.0:1787430955.365639:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787430955.365650:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:19438:x1874256847868032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430955.365725:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:19438:x1874256847868032:12345-0@lo:501:mount.lustre.0 Request processed in 77us (270us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787430955.365733:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787430955.365864:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868032:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787430955.365876:0:19438:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787430955.365895:0:19438:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787430955.365902:0:19438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.365910:0:19438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02e00/0x4dbb683ba6a950a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a950a9 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430955.365936:0:19438:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2b0285b800 10000000:01000000:3.0:1787430955.365941:0:19438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787430955.365946:0:19438:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787430955.365948:0:19438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430955.365952:0:19438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787430955.365955:0:19438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787430955.365975:0:19438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a800/0x4dbb683ba6a9544c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.365982:0:19438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a800/0x4dbb683ba6a9544c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.365998:0:19438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a800/0x4dbb683ba6a9544c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.366010:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787430955.366035:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.366071:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c053490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.366115:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868160 00000100:00100000:0.0:1787430955.366119:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868160 00000100:00100000:0.0:1787430955.366153:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787430955.366160:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:19438:x1874256847868160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430955.366169:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430955.366181:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42174c00/0x4dbb683ba6a95453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9544c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.366214:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42174c00/0x4dbb683ba6a95453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9544c expref: 22 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.366225:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42174c00/0x4dbb683ba6a95453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9544c expref: 22 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.366234:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42174c00, rc 0) 00000100:00100000:0.0:1787430955.366270:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868160:12345-0@lo:101:mount.lustre.0 Request processed in 111us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.366277:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787430955.366338:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430955.366350:0:19438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a800/0x4dbb683ba6a9544c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95453 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.366360:0:19438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a800/0x4dbb683ba6a9544c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95453 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430955.370665:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787430955.372811:0:19438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430955.375830:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787430955.375886:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787430955.375904:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787430955.375918:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787430955.375931:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787430955.375947:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787430955.375974:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787430955.375989:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787430955.376123:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430955.376195:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430955.376244:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430955.376510:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868288 00000100:00100000:1.0:1787430955.376518:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868288 00000100:00100000:1.0:1787430955.376581:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787430955.376620:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430955.376765:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868288:12345-0@lo:501:mount.lustre.0 Request processed in 168us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430955.376774:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787430955.376800:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430955.376838:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430955.376878:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430955.376909:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430955.376970:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868416 00000100:00100000:1.0:1787430955.376975:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868416 00000100:00100000:1.0:1787430955.377006:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787430955.377014:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430955.378268:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868416:12345-0@lo:503:mount.lustre.0 Request processed in 1249us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430955.378279:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787430955.378554:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868416:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787430955.379171:0:19438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430955.379246:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430955.379299:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430955.379375:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430955.379889:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868544 00000100:00100000:1.0:1787430955.379896:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868544 00000100:00100000:1.0:1787430955.379983:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430955.379993:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430955.380439:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868544:12345-0@lo:502:mount.lustre.0 Request processed in 445us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430955.380448:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787430955.380785:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430955.380953:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787430955.380979:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787430955.380992:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787430955.381003:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787430955.381014:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787430955.381025:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787430955.381036:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787430955.381046:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787430955.381072:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787430955.381099:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430955.381138:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430955.381171:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430955.381228:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868672 00000100:00100000:1.0:1787430955.381233:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868672 00000100:00100000:1.0:1787430955.381301:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787430955.381309:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430955.381386:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868672:12345-0@lo:502:mount.lustre.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430955.381403:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787430955.381459:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430955.381503:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787430955.381510:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787430955.382615:0:19442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787430955.382624:0:19442:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787430955.382631:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.382633:0:19442:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787430955.382640:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430955.382655:0:19442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e2b036299b8) 00000020:00000080:3.0:1787430955.382678:0:19442:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787430955.382683:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787430955.382767:0:19442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2b0285b800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787430955.382774:0:19442:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787430955.382779:0:19442:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4dbb683ba6a95461 00010000:00010000:3.0:1787430955.385293:0:19442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787430955.385952:0:19442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1787430955.387160:0:19442:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787430955.388357:0:19442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787430955.388367:0:19442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430955.388373:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430955.388375:0:19442:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787430955.388379:0:19442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430955.388383:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430955.388384:0:19442:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787430955.388387:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787430955.388389:0:19442:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787430955.388404:0:19442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430955.388407:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430955.388409:0:19442:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787430955.388411:0:19442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430955.388414:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430955.388415:0:19442:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787430955.388419:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787430955.388442:0:19442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430955.388444:0:19442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430955.388446:0:19442:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787430955.388449:0:19442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787430955.388539:0:19438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787430955.388585:0:19438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787430955.388627:0:19438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a800/0x4dbb683ba6a9544c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95453 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.388638:0:19438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8a800/0x4dbb683ba6a9544c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95453 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430955.388646:0:19438:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2b0285b800 from 1 10000000:01000000:3.0:1787430955.388648:0:19438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430955.388683:0:19438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.388691:0:19438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.389481:0:19438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.389505:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787430955.389564:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.389623:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fe9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.389743:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868800 00000100:00100000:0.0:1787430955.389755:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868800 00000100:00100000:0.0:1787430955.389802:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787430955.389822:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847868800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430955.389835:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430955.389850:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95468 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.389872:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.389884:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.389893:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c42175200, rc 0) 00000100:00100000:0.0:1787430955.389939:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847868800:12345-0@lo:101:mount.lustre.0 Request processed in 119us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.389946:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787430955.390497:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430955.390513:0:19438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.390522:0:19438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430955.395796:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787430955.396125:0:19438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430955.396330:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787430955.396355:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787430955.396372:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787430955.396377:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787430955.396451:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430955.396513:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430955.396546:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10b2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430955.396647:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847868928 00000100:00100000:1.0:1787430955.396661:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847868928 00000100:00100000:1.0:1787430955.396707:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787430955.396717:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847868928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430955.396824:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847868928:12345-0@lo:501:mount.lustre.0 Request processed in 107us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430955.396832:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787430955.397118:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847868928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430955.397164:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787430955.397204:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.397227:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fe9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.397235:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869056 00000100:00100000:0.0:1787430955.397240:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869056 00000100:00100000:0.0:1787430955.397303:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787430955.397312:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847869056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430955.397395:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847869056:12345-0@lo:503:mount.lustre.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.397402:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787430955.397476:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787430955.397809:0:19438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787430955.397872:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430955.397898:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.397919:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fe9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.397931:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869184 00000100:00100000:0.0:1787430955.397935:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869184 00000100:00100000:0.0:1787430955.398002:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787430955.398009:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847869184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.398106:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847869184:12345-0@lo:502:mount.lustre.0 Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.398113:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787430955.398170:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787430955.398296:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787430955.398312:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787430955.398319:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787430955.398326:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787430955.398332:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787430955.398339:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787430955.398346:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787430955.398361:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787430955.398368:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787430955.398374:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787430955.398381:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787430955.398393:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430955.398416:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.398432:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fe9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.398447:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869312 00000100:00100000:0.0:1787430955.398451:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869312 00000100:00100000:0.0:1787430955.398513:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787430955.398521:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847869312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.398594:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847869312:12345-0@lo:502:mount.lustre.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.398629:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787430955.399107:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787430955.399147:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787430955.399155:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787430955.399748:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430955.399756:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399757:0:19446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787430955.399762:0:19446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2b0285b800 00000020:00000080:3.0:1787430955.399764:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430955.399770:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430955.399771:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399772:0:19446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787430955.399773:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430955.399775:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399776:0:19446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787430955.399778:0:19446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2b0285b800 00000020:00000080:3.0:1787430955.399779:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430955.399827:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430955.399831:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399832:0:19446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787430955.399835:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430955.399837:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399838:0:19446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430955.399841:0:19446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2b0285b800 00000020:00000080:3.0:1787430955.399843:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430955.399861:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430955.399864:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399865:0:19446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430955.399868:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430955.399870:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399871:0:19446:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787430955.399874:0:19446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2b0285b800 00000020:00000080:3.0:1787430955.399876:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430955.399895:0:19446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430955.399897:0:19446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430955.399899:0:19446:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787430955.399901:0:19446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787430955.401705:0:19438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787430955.401748:0:19438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430955.401772:0:19438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.401785:0:19438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430955.401843:0:19438:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787430955.401846:0:19438:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2b0285b800 10000000:01000000:0.0:1787430955.401849:0:19438:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2b0285b800 10000000:01000000:0.0:1787430955.401854:0:19438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430955.401860:0:19438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2b0285b800 from 1 10000000:01000000:0.0:1787430955.401862:0:19438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430955.401896:0:19438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a95476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.401905:0:19438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a95476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.401922:0:19438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a95476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430955.401945:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430955.402005:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.402040:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109ebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.402079:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869440 00000100:00100000:0.0:1787430955.402086:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869440 00000100:00100000:0.0:1787430955.402126:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787430955.402134:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:19438:x1874256847869440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430955.402146:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430955.402158:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a9547d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95476 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.402180:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a9547d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95476 expref: 24 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.402191:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce5400/0x4dbb683ba6a9547d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95476 expref: 24 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.402199:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5400, rc 0) 00000100:00100000:0.0:1787430955.402234:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869440:12345-0@lo:101:mount.lustre.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.402240:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787430955.402285:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430955.402299:0:19438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a95476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9547d expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.402313:0:19438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a95476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9547d expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430955.408278:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787430955.408568:0:19438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430955.408960:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787430955.408985:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787430955.409013:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787430955.409110:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787430955.409125:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787430955.409138:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787430955.409151:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787430955.409163:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787430955.409175:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787430955.409187:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787430955.409201:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787430955.409214:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787430955.409226:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787430955.409240:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787430955.409253:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787430955.409265:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787430955.409277:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787430955.409289:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787430955.409314:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787430955.409329:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787430955.409342:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787430955.409355:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787430955.409367:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787430955.409381:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787430955.409394:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787430955.409407:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787430955.409427:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787430955.409440:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787430955.409452:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787430955.409464:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787430955.409477:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787430955.409489:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787430955.409500:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787430955.409512:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787430955.409537:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787430955.409552:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787430955.409565:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787430955.409576:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787430955.409587:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787430955.409598:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787430955.410262:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787430955.410276:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787430955.410289:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787430955.410302:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787430955.410313:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787430955.410326:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787430955.410347:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787430955.410353:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787430955.410448:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430955.410570:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.410813:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869568 00000100:00100000:0.0:1787430955.410821:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869568 00000100:00100000:0.0:1787430955.410864:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787430955.410874:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430955.410987:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869568:12345-0@lo:501:mount.lustre.0 Request processed in 115us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.411002:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787430955.412259:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c05349e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.412287:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430955.412335:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869696:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430955.412388:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.412418:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869696 00000100:00100000:0.0:1787430955.412423:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869696 00000100:00100000:0.0:1787430955.412454:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787430955.412462:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430955.413117:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869696:12345-0@lo:503:mount.lustre.0 Request processed in 652us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.413124:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787430955.413169:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c05349e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.413185:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869696:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787430955.413948:0:19438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430955.414040:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.414104:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.414142:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869824 00000100:00100000:0.0:1787430955.414148:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869824 00000100:00100000:0.0:1787430955.414198:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787430955.414207:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.414293:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869824:12345-0@lo:502:mount.lustre.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.414300:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787430955.414348:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c224c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.414363:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430955.414538:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787430955.414563:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787430955.414577:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787430955.414590:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787430955.414619:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787430955.414635:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787430955.414649:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787430955.414661:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787430955.414674:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787430955.414686:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787430955.415535:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787430955.415563:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787430955.415577:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787430955.415590:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787430955.415622:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787430955.415638:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787430955.415651:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787430955.415676:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787430955.415691:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787430955.415718:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787430955.415733:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787430955.415746:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787430955.415758:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787430955.415771:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787430955.415782:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787430955.415794:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787430955.415806:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787430955.415817:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787430955.415829:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787430955.415842:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787430955.415864:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787430955.415877:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787430955.415889:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787430955.415911:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787430955.415926:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787430955.415938:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787430955.415950:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787430955.415961:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787430955.415972:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787430955.415982:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787430955.415992:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787430955.416002:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787430955.416012:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787430955.416023:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787430955.416033:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787430955.416044:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787430955.416068:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787430955.416082:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787430955.416131:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.416189:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.416229:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847869952 00000100:00100000:0.0:1787430955.416235:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847869952 00000100:00100000:0.0:1787430955.416270:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787430955.416278:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.416366:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847869952:12345-0@lo:502:mount.lustre.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.416372:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787430955.416439:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c224c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.416457:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847869952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430955.416935:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787430955.416962:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787430955.416984:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847870080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.417145:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.417175:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870080 00000100:00100000:0.0:1787430955.417180:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870080 00000100:00100000:0.0:1787430955.417206:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787430955.417213:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847870080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430955.417283:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847870080:12345-0@lo:502:mount.lustre.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.417290:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787430955.417329:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c224c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430955.417343:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847870080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430955.417376:0:19438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787430955.417384:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787430955.424241:0:19451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787430955.424267:0:19451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e2b04c24d28) 00000020:00000080:1.0:1787430955.424293:0:19451:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787430955.424389:0:19451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2b0285b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787430955.424393:0:19451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2b0285b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787430955.424396:0:19451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2b0285b800 3 00010000:00080000:1.0:1787430955.424427:0:19451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b04c8f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1787430955.430335:0:19451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787430955.430674:0:19451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787430955.430799:0:19451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787430955.430813:0:19451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4dbb683ba6a9548b 00000100:00080000:1.0:1787430955.430822:0:19451:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787430955.430832:0:19451:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2b04c8f000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430955.430868:0:19451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c315ad180 x1874256847870208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430955.430926:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847870208:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787430955.431000:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787430955.431065:0:19451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787430955.433212:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870208 00000100:00100000:0.0:1787430955.433227:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870208 00000100:00100000:0.0:1787430955.433274:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430955.433283:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847870208:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787430955.433310:0:17120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:0.0:1787430955.433358:0:17120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4dbb683ba6a95492 00000004:00100000:0.0:1787430955.433377:0:17120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787430955.433414:0:17120:0:(import.c:65:import_set_state_nolock()) ffff8e2b02878800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787430955.434206:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787430955.434211:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787430955.434214:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430955.434219:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:2.0:1787430955.434223:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787430955.434228:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2c31563000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430955.434247:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03d88a80 x1874256847870592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430955.434279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787430955.434283:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787430955.434286:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787430955.434289:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787430955.434667:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847870336:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.434809:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.434841:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847870976:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.434864:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.434887:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787430955.434894:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847870464:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.434916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.434933:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847871104:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.434952:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.434980:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847870720:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.435001:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.435012:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847871232:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.435031:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.435043:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430955.435048:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847870848:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.435080:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.435111:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870336 00000100:00100000:3.0:1787430955.435117:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870336 00000100:00100000:3.0:1787430955.435153:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870848 00000100:00100000:3.0:1787430955.435156:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870848 00000100:00100000:3.0:1787430955.435173:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430955.435180:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847870336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.435225:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847870336:12345-0@lo:400:kworker.0 Request processed in 45us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430955.435233:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430955.435249:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430955.435255:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847870848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.435292:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847870848:12345-0@lo:400:kworker.0 Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430955.435298:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430955.435317:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787430955.435323:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787430955.435337:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870464 00000100:00100000:3.0:1787430955.435341:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870464 00000100:00100000:3.0:1787430955.435387:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430955.435394:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847870464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.435422:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847870464:12345-0@lo:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430955.435429:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430955.435446:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787430955.435451:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870976 00000100:00100000:3.0:1787430955.435454:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870976 00000100:00100000:0.0:1787430955.435677:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874256847870208:12345-0@lo:38:llog_process_th.0 Request processed in 2393us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.435694:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1787430955.435770:0:19451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:0.0:1787430955.435775:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847871104 00000100:00100000:0.0:1787430955.435779:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847871104 00000020:00000080:1.0:1787430955.435785:0:19451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8e2b04c23370) 00000100:00100000:0.0:1787430955.435793:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870720 00000100:00100000:0.0:1787430955.435795:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870720 00000100:00100000:0.0:1787430955.435804:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847871232 00000100:00100000:0.0:1787430955.435807:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847871232 00000020:00000080:1.0:1787430955.435808:0:19451:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:0.0:1787430955.435819:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430955.435825:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847870976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430955.435853:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847870976:12345-0@lo:400:kworker.0 Request processed in 29us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.435859:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430955.435870:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430955.435876:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847871104:12345-0@lo:400:kworker.0 00000020:01000004:1.0:1787430955.435884:0:19451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2b0285b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787430955.435888:0:19451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2b0285b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787430955.435890:0:19451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2b0285b800 3 00000100:00100000:0.0:1787430955.435897:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847871104:12345-0@lo:400:kworker.0 Request processed in 22us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.435902:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430955.435913:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430955.435918:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847870720:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787430955.435922:0:19451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2b04c8e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.125@tcp at head 00000100:00100000:0.0:1787430955.435939:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874256847870720:12345-0@lo:400:kworker.0 Request processed in 21us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.435944:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430955.435953:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430955.435958:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847871232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430955.435981:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847871232:12345-0@lo:400:kworker.0 Request processed in 23us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.435993:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430955.436026:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847870592:0@lo:8:kworker.0 00000100:00100000:0.0:1787430955.436062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430955.436086:0:19072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847870592 00000100:00100000:1.0:1787430955.436090:0:19072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847870592 00010000:00080000:0.0:1787430955.436099:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2c315ad180 x1874256847870208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430955.436110:0:19072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430955.436110:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1787430955.436115:0:19072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3626:x1874256847870592:12345-0@lo:8:kworker.0 00000100:00080000:0.0:1787430955.436119:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787430955.436125:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787430955.436129:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787430955.436132:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b04c8f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787430955.436139:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1874256847870208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787430955.436218:0:19072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3626:x1874256847870592:12345-0@lo:8:kworker.0 Request processed in 101us (163us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787430955.436224:0:19072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787430955.436566:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430955.436571:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430955.436580:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430955.437484:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847870848:0@lo:400:kworker.0 00010000:00080000:3.0:1787430955.437504:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03d8a300 x1874256847870720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430955.437515:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874256847870720:0@lo:400:kworker.0 00010000:00080000:3.0:1787430955.437527:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03d8b480 x1874256847871232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430955.437535:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847871232:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.437584:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847870464:0@lo:400:kworker.0 00010000:00080000:3.0:1787430955.437596:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03d89880 x1874256847871104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430955.437644:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847871104:0@lo:400:kworker.0 00000100:00100000:3.0:1787430955.437659:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847870336:0@lo:400:kworker.0 00010000:00080000:3.0:1787430955.437670:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03d88700 x1874256847870976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430955.437676:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847870976:0@lo:400:kworker.0 00010000:00010000:2.0:1787430955.441174:0:19451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787430955.441394:0:19451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787430955.441447:0:19451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787430955.441461:0:19451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4dbb683ba6a954a0 00000100:00080000:2.0:1787430955.441472:0:19451:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430955.441478:0:19451:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e2b04c8e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1787430955.441515:0:19451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2b03d8b100 x1874256847871360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430955.441533:0:19451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787430955.441571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787430955.441575:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787430955.441578:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787430955.441583:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787430955.447194:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1874256847871360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787430955.447273:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.447327:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430955.447336:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787430955.447340:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787430955.447344:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847870592:0@lo:8:kworker.0 00000100:00100000:0.0:1787430955.447380:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847871360 00000100:00100000:0.0:1787430955.447386:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847871360 00000100:00100000:0.0:1787430955.447422:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430955.447430:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1874256847871360:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787430955.447458:0:17120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000040:00080000:3.0:1787430955.447934:0:19451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:00000080:0.0:1787430955.448181:0:17120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4dbb683ba6a954a7 00000004:00100000:0.0:1787430955.448198:0:17120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787430955.448241:0:17120:0:(import.c:65:import_set_state_nolock()) ffff8e2b0287f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430955.448301:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874256847871360:12345-0@lo:38:llog_process_th.0 Request processed in 869us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.448310:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787430955.448351:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2b03d8b100 x1874256847871360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430955.448361:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430955.448367:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787430955.448375:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787430955.448379:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787430955.448381:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b04c8e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787430955.448386:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1874256847871360:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787430955.448407:0:19438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787430955.448440:0:19438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430955.448454:0:19438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a95476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9547d expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430955.448466:0:19438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c42175a00/0x4dbb683ba6a95476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9547d expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787430955.449297:0:19438:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787430955.449299:0:19438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787430955.449301:0:19438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430955.449302:0:19438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430955.449303:0:19438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430955.449304:0:19438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430955.449305:0:19438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430955.449307:0:19438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430955.449309:0:19438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430955.449312:0:19438:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787430955.449318:0:19438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430955.449319:0:19438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787430955.449320:0:19438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430955.449321:0:19438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430955.449322:0:19438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430955.449323:0:19438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430955.449323:0:19438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430955.449324:0:19438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430955.449325:0:19438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430955.449345:0:19438:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787430955.449363:0:19438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847871488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787430955.449411:0:19438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.449452:0:19438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c05349180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430955.450367:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847871488 00000100:00100000:1.0:1787430955.450376:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847871488 00000100:00100000:1.0:1787430955.450428:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787430955.450439:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:19438:x1874256847871488:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787430955.450466:0:17114:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787430955.450481:0:17114:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787430955.462444:0:17114:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787430955.462467:0:17114:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787430955.462665:0:17136:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787430955.462670:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787430955.462706:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.462727:0:17136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.462735:0:17136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.462742:0:17136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.462783:0:17136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.462797:0:17136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 24 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.462811:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0483fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847871616:0@lo:104: 00000100:00100000:3.0:1787430955.462892:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430955.462937:0:17136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.462945:0:17136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 24 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.462953:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847871744:0@lo:104: 00000100:00100000:3.0:1787430955.462972:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.462989:0:17136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c10fe9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430955.463008:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847871616 00000100:00100000:3.0:1787430955.463015:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847871616 00000100:00100000:3.0:1787430955.463048:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847871744 00000100:00100000:3.0:1787430955.463063:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847871744 00000100:00100000:3.0:1787430955.463080:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430955.463089:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:17136:x1874256847871616:12345-0@lo:104: 00010000:00010000:3.0:1787430955.463100:0:17103:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463143:0:17103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430955.463149:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:17136:x1874256847871616:12345-0@lo:104: Request processed in 61us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430955.463156:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430955.463171:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430955.463176:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847871744:12345-0@lo:104: 00010000:00010000:3.0:1787430955.463183:0:17103:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463214:0:17103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787430955.463225:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:17136:x1874256847871744:12345-0@lo:104: Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430955.463231:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430955.463262:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0483fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847871616:0@lo:104: 00000100:00100000:3.0:1787430955.463273:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17136:1874256847871744:0@lo:104: 00010000:00010000:3.0:1787430955.463292:0:17136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463310:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430955.463315:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463323:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03a00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430955.463326:0:17108:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463335:0:17108:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430955.463342:0:17108:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430955.463348:0:17108:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430955.463373:0:17108:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463379:0:17108:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430955.463397:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463414:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03a00/0x4dbb683ba6a9536c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95373 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463428:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430955.463430:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463436:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03c00 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:3.0:1787430955.463439:0:17108:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463446:0:17108:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430955.463451:0:17108:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430955.463456:0:17108:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430955.463469:0:17108:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463475:0:17108:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430955.463488:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463493:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f03c00/0x4dbb683ba6a9535e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95365 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463506:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430955.463513:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430955.463514:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430955.463521:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430955.463538:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847871872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430955.463565:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.463629:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847872000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430955.463652:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430955.463682:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847871872 00000100:00100000:3.0:1787430955.463686:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847871872 00010000:00010000:3.0:1787430955.463704:0:17106:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 25 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.463724:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872000 00000100:00100000:3.0:1787430955.463727:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872000 00010000:00010000:3.0:1787430955.463739:0:17106:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 26 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.463757:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430955.463765:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+26:3630:x1874256847871872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430955.463775:0:17106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430955.463780:0:17106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 26 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463790:0:17106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 26 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463803:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a95373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a9536c expref: 26 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463814:0:17106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430955.463848:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+25:3630:x1874256847871872:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430955.463856:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430955.463869:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430955.463876:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3627:x1874256847872000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430955.463883:0:17106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430955.463888:0:17106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 24 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463897:0:17106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 24 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463907:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42174000/0x4dbb683ba6a95365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a9535e expref: 24 pid: 17112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463919:0:17106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463927:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787430955.463940:0:17106:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005093519s 00010000:00010000:3.0:1787430955.463945:0:17106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463952:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463959:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463974:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463979:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ba00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430955.463982:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.463989:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.464000:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.464007:0:17106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430955.464030:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:3627:x1874256847872000:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430955.464037:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430955.464081:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3630:1874256847871872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430955.464096:0:17136:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.464104:0:17136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430955.464110:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ba00/0x4dbb683ba6a954ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430955.464128:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847872000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430955.466281:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:19438:x1874256847871488:12345-0@lo:253:mount.lustre.0 Request processed in 15834us (16859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430955.466294:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787430955.468715:0:19438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:19438:1874256847871488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787430955.468740:0:19438:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787430955.468744:0:19438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430955.468745:0:19438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787430955.468747:0:19438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430955.468748:0:19438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430955.468749:0:19438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430955.468751:0:19438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430955.468752:0:19438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430955.468754:0:19438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430955.468756:0:19438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787430955.468770:0:19438:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1787430955.489940:0:19438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787430955.501147:0:19438:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787430955.501158:0:19438:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787430955.501204:0:19438:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787430955.501251:0:19438:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787430955.501274:0:19438:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787430955.501301:0:19438:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787430955.502084:0:19438:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787430955.502308:0:19438:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787430955.775864:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847872128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430955.775938:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430955.776207:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872128 00000100:00100000:0.0:1787430955.776215:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872128 00000100:00100000:0.0:1787430955.776273:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430955.776283:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847872128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430955.776313:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787430955.776371:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847872128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430955.776378:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430955.776504:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847872128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787430956.167473:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787430956.173994:0:19505:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430956.174269:0:19505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787430956.287750:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847872256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787430956.287821:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430956.287861:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430956.287867:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847872384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430956.287894:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430956.287944:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872256 00000100:00100000:3.0:1787430956.287952:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872256 00000100:00100000:3.0:1787430956.288004:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872384 00000100:00100000:3.0:1787430956.288008:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872384 00000100:00100000:3.0:1787430956.288027:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430956.288037:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847872256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430956.288082:0:17125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787430956.288132:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847872256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430956.288139:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430956.288163:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430956.288170:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847872384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430956.288189:0:17125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787430956.288217:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847872384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430956.288222:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430956.288269:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847872384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430956.288282:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847872256:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1787430956.738103:0:17117:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787430956.738114:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c08afe800 from 10 10000000:01000000:1.0:1787430956.738120:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787430956.738190:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a954b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430956.738206:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a954b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430956.738223:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a954b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430956.738262:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430956.738369:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430956.738427:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c078136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430956.738486:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872512 00000100:00100000:0.0:1787430956.738499:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872512 00000100:00100000:0.0:1787430956.738635:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787430956.738648:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:17117:x1874256847872512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430956.738668:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430956.738687:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce5200/0x4dbb683ba6a954bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a954b5 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430956.738737:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce5200/0x4dbb683ba6a954bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a954b5 expref: 23 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430956.738751:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce5200/0x4dbb683ba6a954bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a954b5 expref: 23 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430956.738764:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5200, rc 0) 00000100:00100000:0.0:1787430956.738820:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847872512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430956.738828:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787430956.738980:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430956.739000:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a954b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a954bc expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430956.739010:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a954b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a954bc expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430956.739108:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787430956.739146:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430956.739876:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430956.743106:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872640 00000100:00100000:1.0:1787430956.743131:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872640 00000100:00100000:1.0:1787430956.743214:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787430956.743229:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847872640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787430956.743270:0:17115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430956.743292:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430956.743298:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787430956.743490:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847872640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 266us (4344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430956.743497:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787430956.743647:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787430956.743731:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430956.743743:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a954b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a954bc expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430956.743754:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee200/0x4dbb683ba6a954b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a954bc expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430956.743765:0:17117:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430956.743767:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2c3a6a7800 from 10 10000000:01000000:3.0:1787430956.743770:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430956.743806:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a954c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430956.743812:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a954c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430956.743820:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a954c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430956.743841:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430956.744481:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430956.745414:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430956.746746:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872768 00000100:00100000:1.0:1787430956.746766:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872768 00000100:00100000:2.0:1787430956.746931:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787430956.746946:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847872768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430956.746971:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430956.746992:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35f03c00/0x4dbb683ba6a954ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a954c3 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430956.747032:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35f03c00/0x4dbb683ba6a954ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a954c3 expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430956.747056:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35f03c00/0x4dbb683ba6a954ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a954c3 expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430956.747069:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35f03c00, rc 0) 00000100:00100000:2.0:1787430956.747152:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847872768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430956.747160:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787430956.747260:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430956.747284:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a954c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a954ca expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430956.747294:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a954c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a954ca expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430956.747448:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787430956.747498:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430956.747547:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430956.747648:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847872896 00000100:00100000:0.0:1787430956.747655:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847872896 00000100:00100000:0.0:1787430956.747692:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787430956.747701:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847872896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787430956.747720:0:17112:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787430956.747740:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787430956.747743:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787430956.747837:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847872896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430956.747844:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787430956.747847:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847872896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787430956.747915:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430956.747922:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a954c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a954ca expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430956.747931:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8ba00/0x4dbb683ba6a954c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a954ca expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430957.184461:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430957.312501:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787430957.509639:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787430958.208257:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430959.231710:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430959.805416:0:19794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787430960.256298:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787430960.395112:0:19846:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787430960.395321:0:19846:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787430960.580003:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430945/real 1787430945] req@ffff8e2b03b19c00 x1874256847861760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430960.580044:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b03b19c00 x1874256847861760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430960.580055:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430945/real 1787430945] req@ffff8e2b03b18a80 x1874256847861888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430960.580067:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2b03b18a80 x1874256847861888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430960.580085:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c079a1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430960.580169:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430960.580174:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847861760:0@lo:8:kworker.0 00000100:00080000:2.0:1787430960.580180:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03dc6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787430960.580411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430960.580416:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787430960.580419:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430960.580437:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2c31563000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430960.580458:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c315adf80 x1874256847873408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430960.580481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430960.580484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787430960.580485:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2c079a1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430960.580489:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1787430960.580493:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787430960.580497:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e2c079a1000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430960.580508:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c315ac700 x1874256847873792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787430960.580515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430960.580518:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787430960.580519:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2b03dc6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430960.580522:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1787430960.580531:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787430960.580535:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e2b03dc6800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1787430960.580548:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2c315af100 x1874256847873920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430960.580598:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847873152:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.580682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430960.580727:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847874048:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.580749:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430960.580762:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847874560:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.580796:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430960.580814:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787430960.580819:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3628:1874256847873024:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.580860:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430960.580880:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847873664:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.580897:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430960.580911:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847874432:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.580932:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430960.580961:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873152 00000100:00100000:1.0:1787430960.580968:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873152 00000100:00100000:1.0:1787430960.581016:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873664 00000100:00100000:1.0:1787430960.581019:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873664 00000100:00100000:1.0:1787430960.581037:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430960.581046:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847873152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581096:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847873152:12345-0@lo:400:kworker.0 Request processed in 50us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.581110:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430960.581125:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430960.581131:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847873664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581156:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847873664:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.581162:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430960.581179:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873024 00000100:00100000:1.0:1787430960.581182:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873024 00000100:00100000:1.0:1787430960.581205:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787430960.581212:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3628:x1874256847873024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581239:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3628:x1874256847873024:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.581244:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787430960.581272:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874048 00000100:00100000:1.0:1787430960.581275:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874048 00000100:00100000:1.0:1787430960.581296:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874560 00000100:00100000:1.0:1787430960.581299:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874560 00000100:00100000:1.0:1787430960.581328:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874432 00000100:00100000:1.0:1787430960.581331:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874432 00000100:00100000:1.0:1787430960.581346:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430960.581351:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847874048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581380:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1874256847874048:12345-0@lo:400:kworker.0 Request processed in 29us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.581386:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430960.581397:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430960.581403:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847874560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581439:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1874256847874560:12345-0@lo:400:kworker.0 Request processed in 37us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.581445:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430960.581456:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787430960.581462:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847874432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581487:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1874256847874432:12345-0@lo:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.581493:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787430960.581525:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3628:1874256847873024:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581536:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847873664:0@lo:400:kworker.0 00010000:00080000:1.0:1787430960.581547:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315af480 x1874256847874432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430960.581557:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1874256847874432:0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.581567:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847873152:0@lo:400:kworker.0 00010000:00080000:1.0:1787430960.581576:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315aed80 x1874256847874048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430960.581583:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1874256847874048:0@lo:400:kworker.0 00010000:00080000:1.0:1787430960.581591:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315ad180 x1874256847874560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430960.581598:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1874256847874560:0@lo:400:kworker.0 00000100:00080000:2.0:1787430960.581928:0:3626:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430960.581934:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847861888:0@lo:8:kworker.0 00000100:00080000:2.0:1787430960.581959:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430960.581963:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787430960.581972:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847873408:0@lo:8:kworker.0 00000100:00100000:2.0:1787430960.582017:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430960.582140:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847873792:0@lo:8:kworker.0 00000100:00100000:2.0:1787430960.582164:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430960.582355:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847873920:0@lo:8:kworker.0 00000100:00100000:2.0:1787430960.582375:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.582431:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873408 00000100:00100000:0.0:1787430960.582437:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873408 00000100:00100000:0.0:1787430960.582458:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873792 00000100:00100000:0.0:1787430960.582460:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873792 00000100:00100000:0.0:1787430960.582485:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430960.582490:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1874256847873408:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787430960.582513:0:18624:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787430960.582538:0:18624:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4dbb683ba6a954d1 00002000:00100000:0.0:1787430960.582551:0:18624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e2c3a671000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787430960.582555:0:18624:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787430960.582557:0:18624:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787430960.582726:0:18624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787430960.582746:0:18624:0:(import.c:65:import_set_state_nolock()) ffff8e2c3a674000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430960.582790:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1874256847873408:12345-0@lo:8:kworker.0 Request processed in 299us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.582797:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430960.582809:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430960.582813:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1874256847873792:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787430960.582826:0:18624:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787430960.582840:0:18624:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a954d8 00002000:00100000:0.0:1787430960.582845:0:18624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e2c3a673800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787430960.582848:0:18624:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787430960.582850:0:18624:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787430960.582882:0:18624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787430960.582893:0:18624:0:(import.c:65:import_set_state_nolock()) ffff8e2b02bc3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430960.582918:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1874256847873792:12345-0@lo:8:kworker.0 Request processed in 104us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.582924:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787430960.583255:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315adf80 x1874256847873408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430960.583270:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787430960.583276:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787430960.583280:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787430960.583283:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c31563000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787430960.583296:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787430960.583301:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1874256847873408:0@lo:8:kworker.0 00000004:00080000:2.0:1787430960.583331:0:17147:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787430960.583345:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17147:1874256847874816:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787430960.583367:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430960.583388:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c1833ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430960.583399:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873920 00000100:00100000:2.0:1787430960.583403:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873920 00000100:00100000:2.0:1787430960.583417:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874816 00000100:00100000:2.0:1787430960.583419:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874816 00000100:00100000:0.0:1787430960.583496:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430960.583502:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1874256847873920:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787430960.583525:0:18622:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787430960.583552:0:18622:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4dbb683ba6a954df 00002000:00100000:0.0:1787430960.583558:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e2c3fe81800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787430960.583561:0:18622:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787430960.583563:0:18622:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787430960.583586:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787430960.583597:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8e2c3fe85000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430960.583640:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1874256847873920:12345-0@lo:8:kworker.0 Request processed in 136us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.583646:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787430960.583731:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787430960.583737:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17147:x1874256847874816:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1787430960.584857:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787430960.584894:0:18624:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787430960.584900:0:18624:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787430960.584905:0:18624:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:0.0:1787430960.585969:0:17146:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787430960.586064:0:17146:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422058462088ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787430960.586073:0:17146:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787430960.586108:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847873536:0@lo:400:kworker.0 00000100:00100000:0.0:1787430960.586169:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.586198:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847874304:0@lo:400:kworker.0 00000100:00100000:0.0:1787430960.586217:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.586239:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787430960.586245:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847873280:0@lo:400:kworker.0 00000100:00100000:0.0:1787430960.586267:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.586279:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847874176:0@lo:400:kworker.0 00000100:00100000:0.0:1787430960.586301:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.586318:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847874688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430960.586340:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.586520:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874688 00000100:00100000:0.0:1787430960.586528:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874688 00000100:00100000:0.0:1787430960.586573:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430960.586583:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847874688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430960.586628:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787430960.586672:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1874256847874688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.586678:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430960.586703:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873536 00000100:00100000:0.0:1787430960.586707:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873536 00000100:00100000:0.0:1787430960.586728:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874304 00000100:00100000:0.0:1787430960.586730:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874304 00000100:00100000:0.0:1787430960.586747:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874176 00000100:00100000:0.0:1787430960.586749:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874176 00000100:00100000:0.0:1787430960.586762:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787430960.586767:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847873536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430960.587116:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874256847873536:12345-0@lo:400:kworker.0 Request processed in 348us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.587123:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787430960.587137:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430960.587144:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847874304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430960.587170:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874256847874304:12345-0@lo:400:kworker.0 Request processed in 28us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.587175:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430960.587185:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430960.587190:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847874176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430960.587212:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874256847874176:12345-0@lo:400:kworker.0 Request processed in 23us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.587225:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787430960.587248:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430960.587252:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430960.587474:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847873280 00000100:00100000:1.0:1787430960.587480:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847873280 00000100:00100000:1.0:1787430960.587520:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430960.587527:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847873280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430960.587564:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847873280:12345-0@lo:400:kworker.0 Request processed in 38us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.587570:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787430960.587933:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430960.587973:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847873280:0@lo:400:kworker.0 00010000:00080000:0.0:1787430960.587988:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315af800 x1874256847874176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430960.587998:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1874256847874176:0@lo:400:kworker.0 00010000:00080000:0.0:1787430960.588019:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03d8b100 x1874256847874688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430960.588034:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847874688:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787430960.588045:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315adc00 x1874256847873536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430960.588053:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874256847873536:0@lo:400:kworker.0 00010000:00080000:0.0:1787430960.588063:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315aca80 x1874256847874304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430960.588070:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1874256847874304:0@lo:400:kworker.0 00000100:00100000:3.0:1787430960.589770:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430960.589782:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787430960.589789:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787430960.589795:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787430960.589798:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2c079a1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787430960.589818:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787430960.589826:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847873792:0@lo:8:kworker.0 00010000:00080000:3.0:1787430960.589842:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c315af100 x1874256847873920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430960.589851:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430960.589855:0:3626:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787430960.589859:0:3626:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787430960.589862:0:3626:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787430960.589870:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8e2b03dc6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787430960.589882:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787430960.589886:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1874256847873920:0@lo:8:kworker.0 00000004:00080000:3.0:1787430960.590590:0:17863:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787430960.590634:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17863:1874256847875072:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787430960.590926:0:17861:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787430960.590941:0:17861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17861:1874256847875328:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787430960.590994:0:17861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.590995:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430960.591017:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847874944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787430960.591033:0:17861:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a6443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430960.591048:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847875200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430960.591057:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.591075:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.591083:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.591094:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430960.591107:0:19072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875328 00000100:00100000:3.0:1787430960.591113:0:19072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875328 00000100:00100000:0.0:1787430960.591116:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847874944 00000100:00100000:0.0:1787430960.591118:0:18627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847874944 00000100:00100000:3.0:1787430960.591154:0:19072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875072 00000100:00100000:3.0:1787430960.591158:0:19072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875072 00000100:00100000:3.0:1787430960.591174:0:19072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430960.591182:0:19072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17861:x1874256847875328:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787430960.591192:0:17859:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787430960.591270:0:17859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 422063667936ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787430960.591276:0:17859:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1787430960.591295:0:17862:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787430960.591321:0:17862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 422063719726ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787430960.591326:0:17862:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787430960.591345:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430960.591353:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:17863:x1874256847875072:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787430960.592627:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875200 00000100:00100000:0.0:1787430960.592633:0:18627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875200 00000100:00100000:0.0:1787430960.592648:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430960.592655:0:18627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3629:x1874256847874944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787430960.592670:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787430960.592732:0:18627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3629:x1874256847874944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.592739:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430960.592755:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430960.592761:0:18627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3627:x1874256847875200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787430960.594058:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787430960.594125:0:18627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3627:x1874256847875200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1362us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.594133:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430960.594193:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847875200:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1787430960.594255:0:17100:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:3.0:1787430960.596319:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430960.596327:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787430960.597157:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b19180 x1874256847874944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430960.597182:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847874944:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1787430960.597377:0:19072:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787430960.597383:0:19072:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787430960.597454:0:19072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17861:x1874256847875328:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6271us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430960.597463:0:19072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430960.597575:0:17861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17861:1874256847875328:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787430960.597593:0:17861:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787430960.597722:0:17861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17861:1874256847875456:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787430960.597758:0:17861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.597778:0:17861:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430960.597793:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875456 00000100:00100000:3.0:1787430960.597800:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875456 00000100:00100000:3.0:1787430960.597833:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430960.597842:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17861:x1874256847875456:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787430960.597865:0:18623:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787430960.597895:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17861:x1874256847875456:12345-0@lo:5:osp-pre-0-1.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430960.597964:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430960.597992:0:17861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b19180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17861:1874256847875456:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787430960.598001:0:17861:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787430960.598036:0:17861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17861:1874256847875584:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787430960.598058:0:17861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.598072:0:17861:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430960.598083:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875584 00000100:00100000:3.0:1787430960.598086:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875584 00000100:00100000:3.0:1787430960.598103:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430960.598110:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17861:x1874256847875584:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787430960.598132:0:18623:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00002000:00080000:0.0:1787430960.600033:0:19073:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787430960.600040:0:19073:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787430960.600102:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17863:x1874256847875072:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8747us (9014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.600111:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:0.0:1787430960.600516:0:17851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1787430960.600537:0:17851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:3.0:1787430960.601177:0:17863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03b18a80 x1874256847875072/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787430976 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430960.601192:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03b18a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17863:1874256847875072:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787430960.601210:0:17863:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787430960.601246:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17863:1874256847875712:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787430960.601285:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.601319:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430960.601336:0:19072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875712 00000100:00100000:3.0:1787430960.601342:0:19072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875712 00000100:00100000:3.0:1787430960.601376:0:19072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787430960.601384:0:19072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17863:x1874256847875712:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787430960.601406:0:19072:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787430960.601438:0:19072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17863:x1874256847875712:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430960.601444:0:19072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787430960.601467:0:17863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d05f80 x1874256847875712/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430976 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430960.601549:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17863:1874256847875712:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787430960.601558:0:17863:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787430960.601581:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17863:1874256847875840:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787430960.601619:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.601634:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430960.601647:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875840 00000100:00100000:3.0:1787430960.601780:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875840 00000100:00100000:3.0:1787430960.601807:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430960.601814:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17863:x1874256847875840:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787430960.601835:0:18622:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1787430960.603333:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.603343:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603360:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.603365:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.603371:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603389:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603398:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603406:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603447:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.603459:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.603464:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603472:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.603477:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603486:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603502:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603510:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b0d050d/0x4dbb683ba6a954e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.603526:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.603528:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.603530:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.603986:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.603992:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604000:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.604023:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.604027:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604036:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604043:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604049:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604065:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787430960.604348:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.604354:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604362:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.604365:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.604369:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604378:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604386:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604398:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604411:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787430960.604418:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430960.604435:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604443:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03a00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.604446:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604454:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604465:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604472:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9d2b94/0x4dbb683ba6a954ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604487:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.604490:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604507:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02200 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.604511:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604518:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604528:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604536:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095e0abc0/0x4dbb683ba6a954f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604548:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.604550:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.604552:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.604556:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.604913:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.604920:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604927:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.604930:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.604934:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604944:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604958:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604965:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604977:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.604984:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.604988:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.604995:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02a00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.604998:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.605016:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.605028:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.605035:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff5074c/0x4dbb683ba6a954fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.605048:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.605054:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.605056:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787430960.606306:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787430960.606314:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.606325:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1787430960.606328:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430960.606333:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.606345:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.606353:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.606360:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.606383:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.607913:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.607925:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.607937:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.607942:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.607951:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.607970:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.607976:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a95502 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.607995:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.607997:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.607998:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.609344:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.609354:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609369:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.609373:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.609388:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609402:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609411:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609418:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609438:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430960.609486:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.609492:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.609499:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f03400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.609503:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.609522:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.609536:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.609543:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000357e14dd/0x4dbb683ba6a95509 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.609563:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.609564:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.609566:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.609924:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.609930:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609939:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.609942:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.609946:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609954:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609962:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.609981:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610002:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430960.610171:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.610177:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610186:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2be00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.610190:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610198:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610210:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610249:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a95510 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610264:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.610266:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.610268:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.610367:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.610373:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610382:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.610384:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.610388:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610397:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610405:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610411:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610435:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430960.610446:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.610450:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610458:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2b800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.610461:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610469:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610493:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610500:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0d48487/0x4dbb683ba6a95517 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610512:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.610514:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.610516:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.610803:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.610809:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610824:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.610827:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.610831:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610841:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610849:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610856:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.610875:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430960.610909:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.610915:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610923:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.610927:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610935:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610946:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610953:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002230c2e7/0x4dbb683ba6a9551e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.610966:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.610968:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.610969:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.611221:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.611227:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.611235:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.611238:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.611243:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.611252:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.611271:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.611279:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.611468:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787430960.612015:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.612022:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.612033:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.612036:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.612040:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.612050:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.612058:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.612066:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613740:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430960.613750:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613763:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.613768:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613790:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613807:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613815:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000904c8968/0x4dbb683ba6a95525 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613833:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.613837:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613844:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2ac00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.613847:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613855:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613864:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.613872:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.613873:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.613881:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.618276:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787430960.618291:0:18624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a9552c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.618335:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.619364:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.619373:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.619388:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.619392:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.619399:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.619413:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.619428:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.619436:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.619456:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430960.619592:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.619614:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.619622:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.619627:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.619636:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.619665:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.619673:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a95533 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.619689:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.619691:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.619692:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.621090:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.621100:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.621119:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.621123:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.621128:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.621138:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.621147:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.621154:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.621169:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430960.621624:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.621630:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.621638:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2aa00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.621642:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.621724:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.621739:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.621746:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13e5302/0x4dbb683ba6a9553a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.621763:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.621765:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.621766:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787430960.622350:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787430960.622357:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.622366:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1787430960.622370:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430960.622374:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.622385:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.622393:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.622406:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.622430:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.622593:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.622625:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.622633:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.622637:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.622645:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.622668:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.622675:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebabf8f9/0x4dbb683ba6a95541 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.622688:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.622691:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.622692:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787430960.624471:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787430960.624545:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.624559:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1787430960.624563:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430960.624568:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.624579:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.624587:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.624594:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.624630:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.624677:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.624684:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.624691:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.624696:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.624705:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.624720:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.624726:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5ba769/0x4dbb683ba6a95548 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.624751:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.624753:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.624754:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787430960.626408:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787430960.626419:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.626438:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1787430960.626443:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430960.626448:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.626462:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.626615:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.626625:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.626645:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.626730:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.626736:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.626743:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.626748:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.626756:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.628239:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.628254:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000743975e5/0x4dbb683ba6a9554f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.628273:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.628274:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.628276:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.630951:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.630964:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.630991:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.630996:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.631013:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.631029:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.631040:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.631049:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.631065:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430960.631130:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430960.631137:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.631145:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2ac00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430960.631150:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.631160:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.631188:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.631196:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f044317/0x4dbb683ba6a95556 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430960.631213:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.631215:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430960.631217:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787430960.639688:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787430960.639700:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639716:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1787430960.639721:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430960.639727:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639742:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639779:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639789:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639808:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.639821:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.639826:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639835:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2b000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.639841:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639850:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639867:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639875:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d91b4c0/0x4dbb683ba6a9555d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.639893:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.639900:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.639902:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430960.640975:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.640986:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.640999:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.641003:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.641019:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641033:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641041:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641061:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641087:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.641393:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.641399:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.641408:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eea00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.641412:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.641428:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.641443:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.641450:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c37a6eb/0x4dbb683ba6a95564 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.641467:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.641469:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.641471:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430960.641586:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.641592:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641631:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.641635:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.641640:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641650:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641658:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641665:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.641681:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430960.642015:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.642021:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642036:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.642039:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.642044:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642055:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642063:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642070:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642083:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787430960.642378:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.642385:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642393:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.642396:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.642400:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642409:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642491:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642498:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642507:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787430960.642908:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.642914:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642923:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.642925:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.642929:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642939:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642948:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642954:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.642974:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787430960.643531:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.643538:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.643548:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.643551:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.643555:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.643564:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.643572:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.643579:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.643588:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787430960.644537:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.644544:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.644555:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.644565:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.644570:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.644581:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.644589:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.644597:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.644626:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1787430960.644720:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787430960.644728:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644736:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef000 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.644741:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644757:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644785:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644793:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001188a021/0x4dbb683ba6a9556b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644813:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787430960.644816:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644823:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.644827:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644834:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644844:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644852:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1e3ecaa/0x4dbb683ba6a95572 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644875:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787430960.644879:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644886:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eee00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.644890:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644898:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644908:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644915:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aea37f8f/0x4dbb683ba6a95579 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644926:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787430960.644929:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644936:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.644939:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644959:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644969:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644977:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009443932f/0x4dbb683ba6a95580 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644989:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430960.644993:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.644999:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.645002:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645021:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645031:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645038:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb173c7/0x4dbb683ba6a95587 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645060:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.645063:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645070:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee800 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.645073:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645080:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645090:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645097:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000089991a7/0x4dbb683ba6a9558e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.645108:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.645110:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.645111:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.645118:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430960.647067:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.647077:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.647093:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.647097:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.647102:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.647115:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.647125:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.647139:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.647163:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.647474:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.647482:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.647490:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efa00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.647499:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.647509:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.647523:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.647531:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cce6df77/0x4dbb683ba6a95595 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.647549:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.647550:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.647552:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430960.648305:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.648314:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.648324:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.648327:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.648332:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.648342:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.648350:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.648358:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.648377:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430960.648655:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.648662:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.648670:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ef400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.648674:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.648682:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.648696:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.648711:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be5bc062/0x4dbb683ba6a9559c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.648727:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.648729:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.648731:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787430960.648951:0:18619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787430960.648961:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787430960.649253:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17861:x1874256847875584:12345-0@lo:5:osp-pre-0-1.0 Request processed in 51139us (51189us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787430960.649269:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:1.0:1787430960.649385:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787430960.649390:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.649405:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787430960.649409:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430960.649413:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.649429:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.649437:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.649445:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430960.649463:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787430960.649501:0:18624:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1787430960.649550:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17147:x1874256847874816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 65812us (66181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.649557:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430960.649646:0:17861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787430960.649655:0:17861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17861:1874256847875584:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787430960.649671:0:17861:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787430960.649715:0:17861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17861:1874256847875968:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787430960.649752:0:17861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.649998:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17147:1874256847874816:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787430960.650019:0:17147:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1787430960.650044:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17147:1874256847876096:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787430960.650069:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.650090:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c02b946c0 going to sleep for 11 seconds 00000001:00080000:0.0:1787430960.650235:0:19439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787430960.650264:0:19439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787430960.650267:0:19439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787430960.650352:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17863:x1874256847875840:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48538us (48731us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787430960.650359:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430960.650375:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876096 00000100:00100000:0.0:1787430960.650380:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876096 00000100:00100000:0.0:1787430960.650412:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430960.650419:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17147:x1874256847876096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787430960.650464:0:18622:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1787430960.650625:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847875968 00000100:00100000:1.0:1787430960.650630:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847875968 00000100:00100000:1.0:1787430960.650654:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430960.650661:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17861:x1874256847875968:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787430960.650698:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17861:x1874256847875968:12345-0@lo:900:osp-pre-0-1.0 Request processed in 38us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.650715:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430960.650853:0:17861:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947300 going to sleep for 11 seconds 00010000:00080000:3.0:1787430960.650871:0:17861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d04380 x1874256847875968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787430976 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430960.650882:0:17861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17861:1874256847875968:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787430960.650915:0:17863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787430960.650920:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17863:1874256847875840:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787430960.650927:0:17863:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787430960.650961:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17863:1874256847876224:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787430960.650985:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430960.651015:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c07947300 going to sleep for 11 seconds 00010000:00010000:2.0:1787430960.651098:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430960.651105:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.651114:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efe00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430960.651119:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.651127:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.651144:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.651151:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008704bc4d/0x4dbb683ba6a955a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430960.651171:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.651173:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430960.651175:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430960.651218:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876224 00000100:00100000:1.0:1787430960.651222:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876224 00000100:00100000:1.0:1787430960.651242:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430960.651248:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17863:x1874256847876224:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787430960.651291:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17863:x1874256847876224:12345-0@lo:900:osp-pre-1-1.0 Request processed in 42us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430960.651298:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787430960.651552:0:17863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b04d05f80 x1874256847876224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787430976 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430960.651563:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17863:1874256847876224:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787430960.655001:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17147:x1874256847876096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4575us (4923us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787430960.655025:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430960.655102:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17147:1874256847876096:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787430960.655118:0:17147:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:1.0:1787430960.895734:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847876352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430960.895810:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430960.896162:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876352 00000100:00100000:0.0:1787430960.896172:0:18627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876352 00000100:00100000:0.0:1787430960.896229:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430960.896239:0:18627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847876352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430960.896260:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787430960.896313:0:18627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847876352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430960.896321:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430960.896372:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847876352:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1787430960.959996:0:19897:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787430960.960243:0:19897:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787430961.144215:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430961.144472:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836280832 00000100:00100000:1.0:1787430961.144485:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836280832 00000100:00100000:1.0:1787430961.144699:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 111 00000100:00100000:1.0:1787430961.144713:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1874256836280832:12345-192.168.202.25@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787430961.144744:0:17114:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3b3576db-2a3d-4843-b6be-497e7f68c8ba@192.168.202.25@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1787430961.144769:0:17114:0:(genops.c:1385:class_connect()) connect: client 3b3576db-2a3d-4843-b6be-497e7f68c8ba, cookie 0x4dbb683ba6a955aa 00000100:00080000:1.0:1787430961.144905:0:17114:0:(import.c:65:import_set_state_nolock()) ffff8e2b04c8e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430961.144972:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+5:2398:x1874256836280832:12345-192.168.202.25@tcp:250:mount.lustre.0 Request processed in 261us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430961.146259:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 111 00000100:00100000:1.0:1787430961.148200:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430961.151846:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836280960 00000100:00100000:0.0:1787430961.151862:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836280960 00000100:00100000:0.0:1787430961.152023:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:0.0:1787430961.152036:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+5:14881:x1874256836280960:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787430961.152052:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430961.152070:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a955b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c2c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430961.152098:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a955b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c2c expref: 6 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430961.152109:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce4c00/0x4dbb683ba6a955b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c2c expref: 6 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430961.152118:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4c00, rc 0) 00000100:00100000:0.0:1787430961.152180:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+6:14881:x1874256836280960:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 147us (3988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430961.152188:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:3.0:1787430961.154075:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430961.164727:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281088 00000100:00100000:1.0:1787430961.164744:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281088 00000100:00100000:1.0:1787430961.165867:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:1.0:1787430961.165884:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+6:14881:x1874256836281088:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787430961.166047:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+6:14881:x1874256836281088:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 168us (11980us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430961.166055:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:3.0:1787430961.168944:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430961.169022:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281216 00000100:00100000:1.0:1787430961.169032:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281216 00000100:00100000:1.0:1787430961.169082:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:1.0:1787430961.169090:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+6:14881:x1874256836281216:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787430961.169105:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430961.169124:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a955b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c33 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430961.169150:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a955b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c33 expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430961.169161:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360efe00/0x4dbb683ba6a955b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c33 expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430961.169170:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360efe00, rc 0) 00000100:00100000:1.0:1787430961.169215:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+7:14881:x1874256836281216:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430961.169220:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:2.0:1787430961.173502:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430961.173629:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281344 00000100:00100000:0.0:1787430961.173640:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281344 00000100:00100000:0.0:1787430961.173695:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:0.0:1787430961.173706:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+7:14881:x1874256836281344:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787430961.173874:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14881:x1874256836281344:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 169us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430961.173896:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:2.0:1787430961.179180:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430961.179232:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281472 00000100:00100000:1.0:1787430961.179244:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281472 00000100:00100000:1.0:1787430961.179305:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:1.0:1787430961.179316:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14881:x1874256836281472:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787430961.179451:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14881:x1874256836281472:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 136us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430961.179466:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:3.0:1787430961.182104:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430961.184393:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281600 00000100:00100000:0.0:1787430961.184407:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281600 00000100:00100000:0.0:1787430961.184477:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 117 00000100:00100000:0.0:1787430961.184488:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14899:x1874256836281600:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430961.185103:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14899:x1874256836281600:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 612us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.185110:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 117 00000100:00100000:2.0:1787430961.204341:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430961.207454:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281728 00000100:00100000:1.0:1787430961.207472:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281728 00000100:00100000:1.0:1787430961.207555:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:1.0:1787430961.207568:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14899:x1874256836281728:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430961.207884:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14899:x1874256836281728:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 317us (3552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.207893:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:3.0:1787430961.217299:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.217398:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281856 00000100:00100000:2.0:1787430961.217410:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281856 00000100:00100000:2.0:1787430961.217467:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:2.0:1787430961.217478:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14899:x1874256836281856:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430961.217656:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14899:x1874256836281856:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 178us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.217664:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:3.0:1787430961.227714:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.228018:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836281984 00000100:00100000:2.0:1787430961.228029:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836281984 00000100:00100000:2.0:1787430961.228100:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:2.0:1787430961.228111:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+8:14881:x1874256836281984:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787430961.228127:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430961.228145:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c3bf2b600/0x4dbb683ba6a955bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c64 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.228172:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c3bf2b600/0x4dbb683ba6a955bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c64 expref: 9 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.228182:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c3bf2b600/0x4dbb683ba6a955bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c64 expref: 9 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.228192:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2b600, rc 0) 00000100:00100000:2.0:1787430961.228259:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+9:14881:x1874256836281984:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 150us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.228266:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:1.0:1787430961.232463:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.232789:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836282112 00000100:00100000:2.0:1787430961.232799:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836282112 00000100:00100000:2.0:1787430961.232890:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:2.0:1787430961.232900:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+9:14881:x1874256836282112:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787430961.232925:0:17112:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787430961.232950:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787430961.232955:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787430961.232959:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787430961.232962:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787430961.232964:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787430961.237906:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+9:14881:x1874256836282112:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 4999us (5444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.237931:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:3.0:1787430961.240482:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.240767:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836282240 00000100:00100000:2.0:1787430961.240777:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836282240 00000100:00100000:2.0:1787430961.240855:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:2.0:1787430961.240863:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+9:14881:x1874256836282240:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787430961.240876:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430961.240890:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c6b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.240911:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.240919:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.240928:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2ba00, rc 0) 00000100:00100000:2.0:1787430961.240979:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14881:x1874256836282240:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 117us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.240987:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:1.0:1787430961.249120:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.249173:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836282368 00000100:00100000:2.0:1787430961.249183:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836282368 00000100:00100000:2.0:1787430961.249237:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:2.0:1787430961.249248:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14881:x1874256836282368:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787430961.249403:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14881:x1874256836282368:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 156us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.249411:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:3.0:1787430961.250500:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.250660:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836282496 00000100:00100000:2.0:1787430961.250666:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836282496 00000100:00100000:2.0:1787430961.250709:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:2.0:1787430961.250717:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14881:x1874256836282496:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787430961.250829:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14881:x1874256836282496:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.250837:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:3.0:1787430961.253862:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.255473:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836282624 00000100:00100000:2.0:1787430961.255488:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836282624 00000100:00100000:2.0:1787430961.255699:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:2.0:1787430961.255711:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14904:x1874256836282624:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430961.255876:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14904:x1874256836282624:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 167us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.255884:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:3.0:1787430961.260833:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430961.263198:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836282752 00000100:00100000:1.0:1787430961.263212:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836282752 00000100:00100000:1.0:1787430961.263447:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:1.0:1787430961.263459:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14904:x1874256836282752:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430961.263637:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:14904:x1874256836282752:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 178us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430961.263645:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:3.0:1787430961.272771:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430961.272862:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430961.272962:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836282880 00000100:00100000:0.0:1787430961.272975:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836282880 00000100:00100000:0.0:1787430961.273043:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283136 00000100:00100000:0.0:1787430961.273046:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283136 00000100:00100000:0.0:1787430961.273073:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1787430961.273081:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1874256836282880:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787430961.273109:0:17122:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c368a6e6-7ccb-40c4-87da-4ec7f1c901a6@192.168.202.25@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787430961.273165:0:17122:0:(genops.c:1385:class_connect()) connect: client c368a6e6-7ccb-40c4-87da-4ec7f1c901a6, cookie 0x4dbb683ba6a955cd 00000004:00100000:0.0:1787430961.273191:0:17122:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787430961.273410:0:17122:0:(import.c:65:import_set_state_nolock()) ffff8e2c3fe83800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430961.273481:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2398:x1874256836282880:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 398us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430961.273488:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1787430961.273505:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1787430961.273510:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1874256836283136:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787430961.273525:0:17122:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c368a6e6-7ccb-40c4-87da-4ec7f1c901a6@192.168.202.25@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787430961.273557:0:17122:0:(genops.c:1385:class_connect()) connect: client c368a6e6-7ccb-40c4-87da-4ec7f1c901a6, cookie 0x4dbb683ba6a955d4 00000004:00100000:0.0:1787430961.273569:0:17122:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787430961.273727:0:17122:0:(import.c:65:import_set_state_nolock()) ffff8e2c3fe86000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430961.273767:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2398:x1874256836283136:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 255us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430961.273774:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:3.0:1787430961.276949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430961.276997:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430961.277130:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.277477:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283392 00000100:00100000:2.0:1787430961.277486:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283392 00000100:00100000:0.0:1787430961.277593:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283264 00000100:00100000:0.0:1787430961.277598:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283264 00000100:00100000:2.0:1787430961.277704:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283008 00000100:00100000:2.0:1787430961.277708:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283008 00000100:00100000:2.0:1787430961.277727:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1787430961.277738:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:14881:x1874256836283392:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787430961.277774:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787430961.277854:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:14881:x1874256836283392:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 117us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.277862:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1787430961.277880:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:2.0:1787430961.277886:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:0:x1874256836283008:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787430961.277910:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787430961.277944:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:0:x1874256836283008:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 57us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.277952:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00080000:3.0:1787430961.278664:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787430961.278670:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430961.278911:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1787430961.279365:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:0:x1874256836283264:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787430961.279393:0:17122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787430961.279483:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:0:x1874256836283264:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 564us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430961.279490:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1787430961.280540:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.280698:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283520 00000100:00100000:2.0:1787430961.280706:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283520 00000100:00100000:2.0:1787430961.280791:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:2.0:1787430961.280801:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14881:x1874256836283520:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787430961.280860:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14881:x1874256836283520:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.280868:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00010000:00010000:2.0:1787430961.281532:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430961.291948:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.292121:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283904 00000100:00100000:2.0:1787430961.292131:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283904 00000100:00100000:2.0:1787430961.292249:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1787430961.292260:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14881:x1874256836283904:12345-192.168.202.25@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787430961.292343:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14881:x1874256836283904:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 85us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.292351:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:3.0:1787430961.295792:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430961.295834:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430961.295872:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430961.295973:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283648 00000100:00100000:0.0:1787430961.295991:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283648 00000100:00100000:0.0:1787430961.296044:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836283776 00000100:00100000:0.0:1787430961.296047:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836283776 00000100:00100000:0.0:1787430961.296070:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1787430961.296080:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874256836283648:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787430961.296115:0:18623:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c368a6e6-7ccb-40c4-87da-4ec7f1c901a6@192.168.202.25@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787430961.296172:0:18623:0:(genops.c:1385:class_connect()) connect: client c368a6e6-7ccb-40c4-87da-4ec7f1c901a6, cookie 0x4dbb683ba6a955db 00002000:00100000:0.0:1787430961.296185:0:18623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c368a6e6-7ccb-40c4-87da-4ec7f1c901a6/ffff8e2c35709800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787430961.296196:0:18623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787430961.296387:0:18623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787430961.296412:0:18623:0:(import.c:65:import_set_state_nolock()) ffff8e2c3570d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430961.296468:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2398:x1874256836283648:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 388us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430961.296484:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1787430961.296502:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1787430961.296507:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874256836283776:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787430961.296522:0:18623:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c368a6e6-7ccb-40c4-87da-4ec7f1c901a6@192.168.202.25@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787430961.296542:0:18623:0:(genops.c:1385:class_connect()) connect: client c368a6e6-7ccb-40c4-87da-4ec7f1c901a6, cookie 0x4dbb683ba6a955e2 00002000:00100000:0.0:1787430961.296548:0:18623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c368a6e6-7ccb-40c4-87da-4ec7f1c901a6/ffff8e2c35709000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787430961.296554:0:18623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787430961.296698:0:18623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787430961.296713:0:18623:0:(import.c:65:import_set_state_nolock()) ffff8e2c35708800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430961.296734:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2398:x1874256836283776:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 225us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430961.296741:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1787430961.297060:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284032 00000100:00100000:2.0:1787430961.297066:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284032 00000100:00100000:2.0:1787430961.297102:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:2.0:1787430961.297109:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14881:x1874256836284032:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787430961.306316:0:17123:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9139us 00000004:00200000:3.0:1787430961.311849:0:17123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787430961.312073:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14881:x1874256836284032:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 14958us (16194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430961.312095:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1787430961.401710:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430961.402041:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284160 00000100:00100000:2.0:1787430961.402054:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284160 00000100:00100000:2.0:1787430961.402120:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:2.0:1787430961.402130:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14927:x1874256836284160:12345-192.168.202.25@tcp:101:mkdir.0 00010000:00010000:2.0:1787430961.402151:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430961.402175:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b200/0x4dbb683ba6a955e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138c9c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.402230:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a955f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.402240:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a955f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.402250:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a955f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430961.402284:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787430961.402286:0:17120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430961.402315:0:17120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a955f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.402333:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b200/0x4dbb683ba6a955e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c9c expref: 8 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.402345:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a955f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c9c expref: 7 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430961.402351:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430961.402353:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430961.402356:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2bc00, rc 0) 00000100:00100000:2.0:1787430961.402405:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:14927:x1874256836284160:12345-192.168.202.25@tcp:101:mkdir.0 Request processed in 276us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.402419:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1787430961.407942:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847876480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430961.408043:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430961.408371:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847876608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430961.408402:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430961.408475:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876480 00000100:00100000:3.0:1787430961.408483:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876480 00000100:00100000:3.0:1787430961.408560:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876608 00000100:00100000:3.0:1787430961.408564:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876608 00000100:00100000:2.0:1787430961.408699:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430961.408710:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847876480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787430961.408737:0:17126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787430961.408798:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847876480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.408805:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430961.408823:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787430961.408830:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847876608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787430961.408842:0:17126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787430961.408854:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847876480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787430961.408907:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847876608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430961.408914:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430961.410474:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847876608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787430962.303918:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430962.954583:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430962.954637:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284288 00000100:00100000:1.0:1787430962.954647:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284288 00000100:00100000:1.0:1787430962.954702:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:1.0:1787430962.954713:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:14979:x1874256836284288:12345-192.168.202.25@tcp:41:lfs.0 00000004:00000024:1.0:1787430962.954750:0:19453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787430962.954831:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:14979:x1874256836284288:12345-192.168.202.25@tcp:41:lfs.0 Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430962.954838:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:1.0:1787430962.956624:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430962.956677:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284416 00000100:00100000:0.0:1787430962.956683:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284416 00000100:00100000:0.0:1787430962.956723:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1787430962.956730:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14979:x1874256836284416:12345-192.168.202.25@tcp:41:lfs.0 00000004:00000024:0.0:1787430962.956759:0:17122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787430962.956821:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14979:x1874256836284416:12345-192.168.202.25@tcp:41:lfs.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430962.956839:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:3.0:1787430962.958849:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430962.959011:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284544 00000100:00100000:0.0:1787430962.959019:0:18627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284544 00000100:00100000:0.0:1787430962.959091:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1787430962.959101:0:18627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14979:x1874256836284544:12345-192.168.202.25@tcp:13:lfs.0 00002000:00000024:0.0:1787430962.959127:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787430962.959205:0:18627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14979:x1874256836284544:12345-192.168.202.25@tcp:13:lfs.0 Request processed in 105us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430962.959212:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00080000:3.0:1787430962.959273:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430962.961034:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430962.961194:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284672 00000100:00100000:0.0:1787430962.961200:0:18627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284672 00000100:00100000:0.0:1787430962.961258:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1787430962.961268:0:18627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14979:x1874256836284672:12345-192.168.202.25@tcp:13:lfs.0 00002000:00000024:0.0:1787430962.961294:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787430962.961385:0:18627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:14979:x1874256836284672:12345-192.168.202.25@tcp:13:lfs.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430962.961402:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00080000:3.0:1787430962.961476:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430963.071547:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.071952:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284800 00000100:00100000:0.0:1787430963.071963:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284800 00000100:00100000:0.0:1787430963.072039:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:0.0:1787430963.072052:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+10:15011:x1874256836284800:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787430963.072069:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430963.072088:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a955f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138ca3 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430963.072118:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a955f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ca3 expref: 11 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430963.072145:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce4200/0x4dbb683ba6a955f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138ca3 expref: 11 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430963.072154:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce4200, rc 0) 00000100:00100000:0.0:1787430963.072296:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15011:x1874256836284800:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 247us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.072304:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:2.0:1787430963.079510:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430963.079640:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836284928 00000100:00100000:1.0:1787430963.079665:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836284928 00000100:00100000:1.0:1787430963.079739:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:1.0:1787430963.079750:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15011:x1874256836284928:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787430963.079938:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15011:x1874256836284928:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 184us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430963.079947:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:3.0:1787430963.083704:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.084252:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285056 00000100:00100000:0.0:1787430963.084263:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285056 00000100:00100000:0.0:1787430963.084323:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:0.0:1787430963.084335:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15011:x1874256836285056:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787430963.085786:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15011:x1874256836285056:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 1445us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.085797:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:3.0:1787430963.098165:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430963.098324:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285184 00000100:00100000:1.0:1787430963.098334:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285184 00000100:00100000:1.0:1787430963.098501:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:1.0:1787430963.098513:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15017:x1874256836285184:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430963.098694:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15017:x1874256836285184:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 183us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430963.098703:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:3.0:1787430963.115915:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.116039:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285312 00000100:00100000:0.0:1787430963.116051:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285312 00000100:00100000:0.0:1787430963.116109:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:0.0:1787430963.116120:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15017:x1874256836285312:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430963.116276:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15017:x1874256836285312:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 158us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.116284:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:3.0:1787430963.120855:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430963.122904:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285440 00000100:00100000:1.0:1787430963.122919:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285440 00000100:00100000:1.0:1787430963.123059:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:1.0:1787430963.123076:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15017:x1874256836285440:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430963.123285:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15017:x1874256836285440:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 205us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430963.123293:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:3.0:1787430963.131980:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.132083:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285568 00000100:00100000:2.0:1787430963.132093:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285568 00000100:00100000:2.0:1787430963.132156:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:2.0:1787430963.132167:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:15011:x1874256836285568:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787430963.132256:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430963.132277:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c3bf2a200/0x4dbb683ba6a955fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138cd4 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.132322:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c3bf2a200/0x4dbb683ba6a955fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cd4 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.132334:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c3bf2a200/0x4dbb683ba6a955fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cd4 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.132345:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2a200, rc 0) 00000100:00100000:2.0:1787430963.132405:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:15011:x1874256836285568:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 239us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.132412:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:3.0:1787430963.137103:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430963.137387:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285696 00000100:00100000:1.0:1787430963.137396:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285696 00000100:00100000:1.0:1787430963.137458:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:1.0:1787430963.137468:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:15011:x1874256836285696:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787430963.137493:0:17114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787430963.137522:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787430963.137526:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787430963.137529:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787430963.137532:0:17114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787430963.137534:0:17114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1787430963.142424:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:15011:x1874256836285696:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 4946us (5318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430963.142440:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:3.0:1787430963.145338:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.145632:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285824 00000100:00100000:0.0:1787430963.145641:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285824 00000100:00100000:0.0:1787430963.145730:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:0.0:1787430963.145750:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:15011:x1874256836285824:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787430963.145779:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430963.145796:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138cdb expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430963.145823:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430963.145835:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430963.145844:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5600, rc 0) 00000100:00100000:0.0:1787430963.145900:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15011:x1874256836285824:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 152us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.145907:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:3.0:1787430963.148514:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430963.148625:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836285952 00000100:00100000:1.0:1787430963.148635:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836285952 00000100:00100000:1.0:1787430963.148685:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:1.0:1787430963.148695:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15011:x1874256836285952:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787430963.148837:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15011:x1874256836285952:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430963.148845:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:3.0:1787430963.150430:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.150497:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286080 00000100:00100000:0.0:1787430963.150502:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286080 00000100:00100000:0.0:1787430963.150586:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:0.0:1787430963.150595:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15011:x1874256836286080:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787430963.150736:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15011:x1874256836286080:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 141us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.150744:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:3.0:1787430963.153094:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.153177:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286208 00000100:00100000:2.0:1787430963.153190:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286208 00000100:00100000:2.0:1787430963.153236:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:2.0:1787430963.153247:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15022:x1874256836286208:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430963.153365:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15022:x1874256836286208:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.153371:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:3.0:1787430963.155479:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.155558:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286336 00000100:00100000:0.0:1787430963.155566:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286336 00000100:00100000:0.0:1787430963.155634:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:0.0:1787430963.155642:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15022:x1874256836286336:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430963.158123:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:15022:x1874256836286336:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 2468us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.158154:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:3.0:1787430963.166506:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.166587:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286464 00000100:00100000:2.0:1787430963.166598:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286464 00000100:00100000:2.0:1787430963.166680:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:2.0:1787430963.166689:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1874256836286464:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787430963.166719:0:17121:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f5be954f-625f-494d-992d-9b94f56b0aac@192.168.202.25@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1787430963.166768:0:17121:0:(genops.c:1385:class_connect()) connect: client f5be954f-625f-494d-992d-9b94f56b0aac, cookie 0x4dbb683ba6a9560c 00000004:00100000:2.0:1787430963.166792:0:17121:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787430963.166880:0:17121:0:(import.c:65:import_set_state_nolock()) ffff8e2c3fe73800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430963.166955:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.166961:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:2398:x1874256836286464:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 268us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.166971:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:3.0:1787430963.170201:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.172314:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286720 00000100:00100000:2.0:1787430963.172330:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286720 00000100:00100000:2.0:1787430963.172453:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1787430963.172463:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1874256836286720:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787430963.172499:0:17121:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f5be954f-625f-494d-992d-9b94f56b0aac@192.168.202.25@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1787430963.172561:0:17121:0:(genops.c:1385:class_connect()) connect: client f5be954f-625f-494d-992d-9b94f56b0aac, cookie 0x4dbb683ba6a95613 00000004:00100000:2.0:1787430963.172597:0:17121:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787430963.172721:0:17121:0:(import.c:65:import_set_state_nolock()) ffff8e2c3fe76800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430963.173340:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:2398:x1874256836286720:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 874us (6383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.173353:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1787430963.173886:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286592 00000100:00100000:1.0:1787430963.173893:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286592 00000100:00100000:1.0:1787430963.173939:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1787430963.173949:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+6:0:x1874256836286592:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787430963.174051:0:17122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787430963.174094:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+6:0:x1874256836286592:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 146us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430963.174101:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1787430963.174181:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430963.174200:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286976 00000100:00100000:1.0:1787430963.174203:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286976 00000100:00100000:1.0:1787430963.174222:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:1.0:1787430963.174240:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836286976:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787430963.174252:0:17122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787430963.174277:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836286976:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 38us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430963.174283:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00080000:1.0:1787430963.174689:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430963.181515:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430963.181915:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.182384:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836287104 00000100:00100000:2.0:1787430963.182394:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836287104 00000100:00100000:2.0:1787430963.182486:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836286848 00000100:00100000:2.0:1787430963.182490:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836286848 00000100:00100000:2.0:1787430963.182546:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:2.0:1787430963.182558:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836287104:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787430963.182661:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836287104:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 105us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.182669:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:2.0:1787430963.182686:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1787430963.182693:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:0:x1874256836286848:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787430963.182709:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787430963.182761:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:0:x1874256836286848:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 67us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.182767:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00080000:3.0:1787430963.183415:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787430963.184576:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.184661:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836287232 00000100:00100000:2.0:1787430963.184669:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836287232 00000100:00100000:2.0:1787430963.184714:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:2.0:1787430963.184722:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874256836287232:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787430963.184871:0:18622:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f5be954f-625f-494d-992d-9b94f56b0aac@192.168.202.25@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1787430963.184900:0:18622:0:(genops.c:1385:class_connect()) connect: client f5be954f-625f-494d-992d-9b94f56b0aac, cookie 0x4dbb683ba6a9561a 00002000:00100000:2.0:1787430963.184912:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f5be954f-625f-494d-992d-9b94f56b0aac/ffff8e2c3fe76000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430963.184924:0:18622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787430963.185001:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787430963.185030:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8e2c3fe75800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430963.185095:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f5be954f-625f-494d-992d-9b94f56b0aac+6:2398:x1874256836287232:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 372us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.185103:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:2.0:1787430963.186342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.186671:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836287360 00000100:00100000:0.0:1787430963.186679:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836287360 00000100:00100000:0.0:1787430963.186718:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:0.0:1787430963.186727:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1874256836287360:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787430963.186754:0:19073:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f5be954f-625f-494d-992d-9b94f56b0aac@192.168.202.25@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:0.0:1787430963.186803:0:19073:0:(genops.c:1385:class_connect()) connect: client f5be954f-625f-494d-992d-9b94f56b0aac, cookie 0x4dbb683ba6a95621 00002000:00100000:0.0:1787430963.186814:0:19073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f5be954f-625f-494d-992d-9b94f56b0aac/ffff8e2c3570c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787430963.186823:0:19073:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787430963.186873:0:19073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787430963.186899:0:19073:0:(import.c:65:import_set_state_nolock()) ffff8e2c3570a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430963.187504:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f5be954f-625f-494d-992d-9b94f56b0aac+6:2398:x1874256836287360:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 775us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.187517:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1787430963.187813:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.190349:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836287488 00000100:00100000:0.0:1787430963.190362:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836287488 00000100:00100000:0.0:1787430963.190418:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:0.0:1787430963.190430:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836287488:12345-192.168.202.25@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787430963.190503:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836287488:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 75us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.190511:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:3.0:1787430963.192191:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430963.192304:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836287616 00000100:00100000:0.0:1787430963.192311:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836287616 00000100:00100000:0.0:1787430963.192366:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:0.0:1787430963.192375:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836287616:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787430963.192461:0:17124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787430963.193179:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:15011:x1874256836287616:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 802us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430963.193188:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:1.0:1787430963.271467:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430963.271697:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836287744 00000100:00100000:2.0:1787430963.271708:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836287744 00000100:00100000:2.0:1787430963.271834:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1787430963.271843:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:15045:x1874256836287744:12345-192.168.202.25@tcp:101:mkdir.0 00010000:00010000:2.0:1787430963.271861:0:17121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430963.271878:0:17121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d0c expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.271933:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.271961:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.271974:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430963.272049:0:17121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787430963.272053:0:17121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430963.272074:0:17121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.272097:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 8 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.272111:0:17121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 7 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430963.272117:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430963.272119:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430963.272121:0:17121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2a000, rc 0) 00000100:00100000:2.0:1787430963.272187:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+7:15045:x1874256836287744:12345-192.168.202.25@tcp:101:mkdir.0 Request processed in 345us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430963.272196:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00010000:00010000:2.0:1787430963.331713:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430964.351983:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430965.103455:0:19994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787430965.379123:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430966.016080:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847876736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430966.016155:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.016236:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876736 00000100:00100000:3.0:1787430966.016244:0:18627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876736 00000100:00100000:3.0:1787430966.016297:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430966.016307:0:18627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847876736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787430966.016338:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787430966.016383:0:18627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847876736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.016390:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787430966.016410:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430966.016448:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847876736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430966.018774:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847876992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787430966.019071:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.019132:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847877504:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.019163:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.019191:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847878016:0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.019193:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847877504 00000100:00100000:1.0:1787430966.019202:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847877504 00000100:00100000:3.0:1787430966.019213:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.019236:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847878528:0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.019260:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878016 00000100:00100000:1.0:1787430966.019264:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878016 00000100:00100000:3.0:1787430966.019268:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.019296:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787430966.019297:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430966.019306:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847877120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430966.019312:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847877504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.019337:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430966.019369:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847877504:12345-0@lo:400:kworker.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430966.019377:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430966.019394:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430966.019401:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847878016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.019433:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847878016:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430966.019439:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430966.020243:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847876864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430966.020280:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.020405:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847877632:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.020508:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.020534:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847878144:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.020558:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.020577:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847878656:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.020634:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.020670:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847877504:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.020682:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847878016:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.020712:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847877632 00000100:00100000:3.0:1787430966.020716:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847877632 00000100:00100000:3.0:1787430966.020752:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430966.020760:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847877632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.021055:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847877632:12345-0@lo:400:kworker.0 Request processed in 294us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.021065:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430966.021083:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878528 00000100:00100000:1.0:1787430966.021089:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878528 00000100:00100000:1.0:1787430966.021119:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878144 00000100:00100000:1.0:1787430966.021122:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878144 00000100:00100000:1.0:1787430966.021131:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878656 00000100:00100000:1.0:1787430966.021133:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878656 00000100:00100000:1.0:1787430966.021147:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430966.021163:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787430966.021164:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847878528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.021177:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847878144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.021208:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847878528:12345-0@lo:400:kworker.0 Request processed in 48us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430966.021217:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430966.021224:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874256847878144:12345-0@lo:400:kworker.0 Request processed in 50us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430966.021233:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430966.021241:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847878656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.021245:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787430966.021280:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874256847878656:12345-0@lo:400:kworker.0 Request processed in 40us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.021284:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876992 00000100:00100000:3.0:1787430966.021289:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876992 00000100:00100000:1.0:1787430966.021289:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787430966.021313:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847877120 00000100:00100000:3.0:1787430966.021316:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847877120 00000100:00100000:3.0:1787430966.021326:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847876864 00000100:00100000:3.0:1787430966.021328:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847876864 00000100:00100000:3.0:1787430966.021339:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430966.021352:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847876992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787430966.021372:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787430966.021406:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847876992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.021412:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430966.021420:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847877248:0@lo:400:kworker.0 00000100:00100000:0.0:1787430966.021455:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430966.021490:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847877760:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.021496:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430966.021498:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847877248 00000100:00100000:1.0:1787430966.021504:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847877248 00000100:00100000:3.0:1787430966.021508:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847877120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430966.021519:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787430966.021521:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787430966.021538:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787430966.021547:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3627:x1874256847877248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430966.021909:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847878272:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.021923:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1874256847877120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 418us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.021931:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430966.021940:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430966.021948:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430966.021973:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847876864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430966.021984:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787430966.022017:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3627:x1874256847877248:12345-0@lo:400:kworker.0 Request processed in 470us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430966.022025:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787430966.022045:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3627:1874256847877248:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.022081:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847876864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.022088:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430966.022167:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847877760 00000100:00100000:3.0:1787430966.022172:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847877760 00000100:00100000:3.0:1787430966.022199:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878272 00000100:00100000:3.0:1787430966.022202:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878272 00000100:00100000:1.0:1787430966.022234:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430966.022244:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430966.022245:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847877760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.022258:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847878272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.022288:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847877760:12345-0@lo:400:kworker.0 Request processed in 47us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430966.022295:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787430966.022323:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847877760:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.022526:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847878272:12345-0@lo:400:kworker.0 Request processed in 272us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.022533:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430966.022554:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847878272:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.022592:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847876864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430966.022737:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847877376:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.022771:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430966.022799:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847877376 00000100:00100000:1.0:1787430966.022805:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847877376 00000100:00100000:1.0:1787430966.022837:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430966.022844:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847877376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.022869:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847877888:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.022975:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430966.022981:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847877376:12345-0@lo:400:kworker.0 Request processed in 136us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430966.022989:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430966.023005:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847877888 00000100:00100000:1.0:1787430966.023009:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847877888 00000100:00100000:1.0:1787430966.023026:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787430966.023032:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847877888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.023068:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847877888:12345-0@lo:400:kworker.0 Request processed in 36us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.023072:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847877888:0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.023078:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430966.023086:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847878400:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.023178:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430966.023213:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878400 00000100:00100000:1.0:1787430966.023218:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878400 00000100:00100000:3.0:1787430966.023223:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847877376:0@lo:400:kworker.0 00000100:00080000:3.0:1787430966.023259:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787430966.023263:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787430966.023265:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430966.023271:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430966.023274:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847878400:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787430966.023275:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430966.023308:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847877120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430966.023320:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1874256847878400:12345-0@lo:400:kworker.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.023325:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847877632:0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.023330:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430966.023344:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874256847878144:0@lo:400:kworker.0 00010000:00080000:3.0:1787430966.023365:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2c35d63b80 x1874256847878656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787430966.023366:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03fcf480 x1874256847878400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430966.023396:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1874256847878656:0@lo:400:kworker.0 00000100:00100000:1.0:1787430966.023397:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1874256847878400:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.023483:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847878528:0@lo:400:kworker.0 00000100:00100000:3.0:1787430966.023505:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847876992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787430966.399688:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430966.528272:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847878784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430966.528349:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430966.528406:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878784 00000100:00100000:0.0:1787430966.528414:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878784 00000100:00100000:0.0:1787430966.528459:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430966.528469:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847878784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787430966.528501:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787430966.528553:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847878784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430966.528567:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787430966.529544:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847878784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787430966.533588:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847878912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787430966.533696:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1787430966.533855:0:19439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f5be954f-625f-494d-992d-9b94f56b0aac 00000001:00100000:0.0:1787430966.533868:0:19439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c368a6e6-7ccb-40c4-87da-4ec7f1c901a6 00000001:00080000:0.0:1787430966.533877:0:19439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1787430966.533910:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847878912 00000100:00100000:3.0:1787430966.533924:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847878912 00000100:00100000:3.0:1787430966.533995:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787430966.534006:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847878912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787430966.534048:0:17126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787430966.540708:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1874256847878912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6693us (7001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430966.540723:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430966.541273:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1874256847878912:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1787430967.418197:0:20141:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9a4edd90 20000000:00000080:2.0:1787430967.418215:0:20141:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2c3fe8dc00 uarg=0000000000000000 20000000:01000000:2.0:1787430967.418259:0:20141:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787430967.418265:0:20141:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787430967.418269:0:20141:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787430967.419050:0:20142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787430967.419961:0:20141:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787430967.433059:0:20141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787430967.433121:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430967.433141:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433160:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433168:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433175:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 23 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433181:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433192:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433198:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433206:0:20141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433249:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.433276:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 12 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.433292:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879040:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430967.434659:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.434673:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 12 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.434684:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879168:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430967.434723:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.434731:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 23 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.434741:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879296:0@lo:104: 00000100:00100000:2.0:1787430967.434782:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430967.434815:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 23 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.434823:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 23 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.434831:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879424:0@lo:104: 00000100:00100000:2.0:1787430967.434852:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430967.434972:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.434981:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 23 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.434989:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879552:0@lo:104: 00000100:00100000:2.0:1787430967.435009:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430967.435024:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.435031:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 23 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.435039:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879680:0@lo:104: 00000100:00100000:2.0:1787430967.435057:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430967.435067:0:20141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b03fdf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430967.435190:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847879296 00000100:00100000:1.0:1787430967.435198:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847879296 00000100:00100000:1.0:1787430967.435234:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847879424 00000100:00100000:1.0:1787430967.435237:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847879424 00000100:00100000:1.0:1787430967.435247:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847879552 00000100:00100000:1.0:1787430967.435250:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847879552 00000100:00100000:1.0:1787430967.435259:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847879680 00000100:00100000:1.0:1787430967.435262:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847879680 00000100:00100000:1.0:1787430967.435275:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430967.435284:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+6:20141:x1874256847879296:12345-0@lo:104: 00010000:00010000:1.0:1787430967.435296:0:17104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.435358:0:17104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430967.435427:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+6:20141:x1874256847879296:12345-0@lo:104: Request processed in 144us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430967.435434:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430967.435450:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430967.435457:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+5:20141:x1874256847879424:12345-0@lo:104: 00010000:00010000:1.0:1787430967.435464:0:17104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.436630:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879296:0@lo:104: 00010000:00010000:1.0:1787430967.436725:0:17104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430967.436733:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+5:20141:x1874256847879424:12345-0@lo:104: Request processed in 1277us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430967.436741:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430967.436761:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430967.436769:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:20141:x1874256847879552:12345-0@lo:104: 00010000:00010000:1.0:1787430967.436789:0:17104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.436831:0:17104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787430967.436836:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+4:20141:x1874256847879552:12345-0@lo:104: Request processed in 69us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430967.436842:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430967.436853:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787430967.436858:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:20141:x1874256847879680:12345-0@lo:104: 00010000:00010000:1.0:1787430967.436930:0:17104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.436967:0:17104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787430967.436972:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+3:20141:x1874256847879680:12345-0@lo:104: Request processed in 115us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430967.436978:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787430967.436994:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787430967.437000:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437008:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8b400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430967.437012:0:17109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437021:0:17109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430967.437029:0:17109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430967.437040:0:17109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430967.437068:0:17109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437075:0:17109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430967.437095:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437102:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8b400/0x4dbb683ba6a95468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a9546f expref: -99 pid: 19438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437117:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787430967.437121:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437127:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35f02400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430967.437130:0:17109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437137:0:17109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430967.437143:0:17109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430967.437149:0:17109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430967.437162:0:17109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437168:0:17109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430967.437180:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437187:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2c35f02400/0x4dbb683ba6a95311 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a95318 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437197:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430967.437200:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437205:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5800 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430967.437209:0:17109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437215:0:17109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430967.437221:0:17109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430967.437226:0:17109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430967.437237:0:17109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437242:0:17109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430967.437256:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437263:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5800/0x4dbb683ba6a952d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952d9 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437279:0:17109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430967.437282:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437288:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4400 already unused, calling callback (ffffffffc144ec20) 10000000:00010000:1.0:1787430967.437291:0:17109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437298:0:17109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430967.437304:0:17109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430967.437309:0:17109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430967.437319:0:17109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437324:0:17109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430967.437329:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437336:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4400/0x4dbb683ba6a952c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4dbb683ba6a952cb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430967.437347:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430967.437348:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430967.437350:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430967.437477:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879424:0@lo:104: 00000100:00100000:2.0:1787430967.437587:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879552:0@lo:104: 00000100:00100000:2.0:1787430967.437617:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879680:0@lo:104: 00010000:00010000:3.0:1787430967.437669:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430967.437692:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847879808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430967.437728:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430967.437768:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430967.437774:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847879936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430967.437791:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430967.437814:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847879808 00000100:00100000:3.0:1787430967.437820:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847879808 00010000:00010000:3.0:1787430967.437841:0:18650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 24 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430967.437860:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847879936 00000100:00100000:3.0:1787430967.437928:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847879936 00010000:00010000:3.0:1787430967.437953:0:18650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 25 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430967.437973:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430967.437981:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+25:3629:x1874256847879808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430967.437991:0:18650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430967.437996:0:18650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 25 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.438018:0:18650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 25 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.438033:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c42175200/0x4dbb683ba6a9546f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a95468 expref: 25 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.438048:0:18650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430967.438077:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3629:x1874256847879808:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430967.438083:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430967.438097:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430967.438103:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:3629:x1874256847879936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430967.438110:0:18650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430967.438114:0:18650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 23 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.438122:0:18650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 23 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.438132:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8aa00/0x4dbb683ba6a95318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a95311 expref: 23 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.438140:0:18650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430967.438161:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:3629:x1874256847879936:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430967.438166:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430967.438196:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847879936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430967.438203:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847879808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430967.438935:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3628:1874256847880192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430967.438978:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430967.439006:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430967.439011:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3628:1874256847880064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430967.439028:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430967.439353:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880192 00000100:00100000:0.0:1787430967.439359:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880192 00010000:00010000:0.0:1787430967.439394:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 22 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430967.439423:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880064 00000100:00100000:0.0:1787430967.439427:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880064 00010000:00010000:0.0:1787430967.439438:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 23 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430967.439465:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430967.439473:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:3628:x1874256847880192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430967.439482:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430967.439695:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 23 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430967.439706:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 23 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430967.439719:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8bc00/0x4dbb683ba6a952cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a952c4 expref: 23 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430967.439729:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430967.439764:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:3628:x1874256847880192:12345-0@lo:103:ldlm_bl.0 Request processed in 292us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430967.439779:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430967.439795:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430967.439800:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:3628:x1874256847880064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430967.439807:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430967.439811:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 21 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430967.439819:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 21 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430967.439828:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c35e8ae00/0x4dbb683ba6a952d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4dbb683ba6a952d2 expref: 21 pid: 17114 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430967.439836:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430967.439857:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:3628:x1874256847880064:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430967.439875:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430967.439903:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3628:1874256847880064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430967.439910:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3628:1874256847880192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430967.440805:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d8a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879040:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430967.440985:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03d88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1874256847879168:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430967.440998:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00010000:00010000:0.0:1787430967.441012:0:20141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430967.441070:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836287872 00000100:00100000:3.0:1787430967.441075:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836287872 00010000:00010000:3.0:1787430967.441096:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 13 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430967.441117:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:3.0:1787430967.441123:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36174050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:2400:x1874256836287872:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430967.441131:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430967.441134:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 13 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.441142:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 13 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.441152:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2b03ce5600/0x4dbb683ba6a95605 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138cdb expref: 13 pid: 17112 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430967.441161:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430967.441204:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36174050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:2400:x1874256836287872:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430967.441212:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1787430967.442378:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430967.442452:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288000 00000100:00100000:2.0:1787430967.442458:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288000 00010000:00010000:2.0:1787430967.442502:0:17106:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 12 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.442538:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:2.0:1787430967.442547:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:2400:x1874256836288000:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430967.442555:0:17106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430967.442559:0:17106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 12 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442566:0:17106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 12 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442576:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c3bf2ba00/0x4dbb683ba6a955c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c6b expref: 12 pid: 17115 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442586:0:17106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442592:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442626:0:17106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442633:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442641:0:17106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442648:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442662:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2b400 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430967.442666:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442674:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442692:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430967.442701:0:17106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430967.442716:0:20141:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430967.442740:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:2400:x1874256836288000:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 193us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430967.442747:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00010000:00010000:0.0:1787430967.442800:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430967.442805:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2c3bf2b400/0x4dbb683ba6a95636 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430967.552297:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787430967.557450:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f5be954f-625f-494d-992d-9b94f56b0aac 00000001:00100000:3.0:1787430967.557460:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c368a6e6-7ccb-40c4-87da-4ec7f1c901a6 00000001:00100000:1.0:1787430967.557719:0:17851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f5be954f-625f-494d-992d-9b94f56b0aac 00000001:00100000:1.0:1787430967.557727:0:17851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c368a6e6-7ccb-40c4-87da-4ec7f1c901a6 00000001:00100000:1.0:1787430967.567477:0:17100:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f5be954f-625f-494d-992d-9b94f56b0aac 00000001:00100000:1.0:1787430967.567489:0:17100:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c368a6e6-7ccb-40c4-87da-4ec7f1c901a6 00000040:00080000:1.0:1787430967.745084:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787430968.318501:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430968.318542:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430968.318569:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430968.318633:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430968.318643:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288256 00000100:00100000:1.0:1787430968.318657:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430968.318663:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288256 00000100:00100000:1.0:1787430968.318678:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430968.318699:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430968.318715:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430968.318735:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430968.318755:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288512 00000100:00100000:1.0:1787430968.318759:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288512 00000100:00100000:3.0:1787430968.318814:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288384 00000100:00100000:3.0:1787430968.318819:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288384 00000100:00100000:2.0:1787430968.318824:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288768 00000100:00100000:2.0:1787430968.318830:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288768 00000100:00100000:0.0:1787430968.318873:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288128 00000100:00100000:0.0:1787430968.318878:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288128 00000100:00100000:0.0:1787430968.318912:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:0.0:1787430968.318923:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3cfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:2402:x1874256836288128:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430968.319003:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3cfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:2402:x1874256836288128:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 81us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430968.319010:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:0.0:1787430968.319052:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288896 00000100:00100000:0.0:1787430968.319056:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288896 00000100:00100000:1.0:1787430968.319496:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836288640 00000100:00100000:1.0:1787430968.319500:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836288640 00000100:00100000:1.0:1787430968.319516:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289152 00000100:00100000:1.0:1787430968.319518:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289152 00000100:00100000:1.0:1787430968.319528:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289024 00000100:00100000:1.0:1787430968.319530:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289024 00000100:00100000:1.0:1787430968.319543:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1787430968.319550:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2401:x1874256836288512:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430968.319577:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2401:x1874256836288512:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.319584:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1787430968.319594:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1787430968.319639:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2402:x1874256836288640:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430968.319664:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2402:x1874256836288640:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.319669:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1787430968.319680:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1787430968.319685:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5be954f-625f-494d-992d-9b94f56b0aac+5:2402:x1874256836289152:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430968.319700:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5be954f-625f-494d-992d-9b94f56b0aac+5:2402:x1874256836289152:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 15us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.319706:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1787430968.319714:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:1.0:1787430968.319719:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5be954f-625f-494d-992d-9b94f56b0aac+5:2401:x1874256836289024:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430968.319734:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5be954f-625f-494d-992d-9b94f56b0aac+5:2401:x1874256836289024:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 15us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.319739:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:1.0:1787430968.319754:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:1.0:1787430968.319761:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2401:x1874256836288256:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1787430968.319782:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2401:x1874256836288256:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.319792:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:2.0:1787430968.319921:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:2.0:1787430968.319932:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:2401:x1874256836288768:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1787430968.319978:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+6:2401:x1874256836288768:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 48us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430968.319987:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00080000:2.0:1787430968.320014:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430968.320019:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787430968.320023:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430968.320026:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430968.323227:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1787430968.323245:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2402:x1874256836288384:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1787430968.323321:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2402:x1874256836288384:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 81us (4751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430968.323328:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:0.0:1787430968.323942:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1787430968.323951:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5be954f-625f-494d-992d-9b94f56b0aac+5:2402:x1874256836288896:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1787430968.323978:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5be954f-625f-494d-992d-9b94f56b0aac+5:2402:x1874256836288896:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (5278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430968.323984:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00010000:00010000:1.0:1787430968.453680:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787430968.959741:0:17117:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430968.959750:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2b0285b800 from 13 10000000:01000000:3.0:1787430968.959757:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430968.959814:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a9563d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430968.959826:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a9563d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430968.959837:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a9563d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430968.959864:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430968.959955:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430968.960010:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c09165cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.964031:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880320 00000100:00100000:1.0:1787430968.964047:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880320 00000100:00100000:1.0:1787430968.964123:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787430968.964134:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+20:17117:x1874256847880320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430968.964165:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430968.964186:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a95644 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9563d expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.964214:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a95644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9563d expref: 21 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.964224:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360ef400/0x4dbb683ba6a95644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9563d expref: 21 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.964232:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef400, rc 0) 00000100:00100000:1.0:1787430968.964321:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847880320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.964328:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787430968.964446:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430968.964464:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a9563d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95644 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430968.964473:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a9563d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95644 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430968.964548:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430968.964583:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430968.964653:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c09165cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.964714:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880448 00000100:00100000:1.0:1787430968.964718:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880448 00000100:00100000:1.0:1787430968.964753:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787430968.964761:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847880448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430968.964869:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847880448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.964876:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787430968.965008:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430968.965035:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430968.965072:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430968.965093:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c09165cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.965142:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880576 00000100:00100000:1.0:1787430968.965147:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880576 00000100:00100000:1.0:1787430968.965177:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787430968.965183:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847880576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430968.965262:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847880576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.965278:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787430968.965441:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430968.966292:0:20251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787430968.969116:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787430968.969162:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430968.969175:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a9563d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95644 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.969188:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c35e8aa00/0x4dbb683ba6a9563d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95644 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430968.969219:0:17117:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430968.969222:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c35cb3800 from 13 10000000:01000000:0.0:1787430968.969225:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430968.969269:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4600/0x4dbb683ba6a9564b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.969277:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4600/0x4dbb683ba6a9564b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.969289:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4600/0x4dbb683ba6a9564b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430968.969314:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.969386:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.969480:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c2e24ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.969535:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880704 00000100:00100000:1.0:1787430968.969543:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880704 00000100:00100000:1.0:1787430968.969659:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787430968.969669:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+21:17117:x1874256847880704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430968.969692:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430968.969704:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360efa00/0x4dbb683ba6a95652 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a9564b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.969725:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360efa00/0x4dbb683ba6a95652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a9564b expref: 22 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.969736:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360efa00/0x4dbb683ba6a95652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a9564b expref: 22 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.969745:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360efa00, rc 0) 00000100:00100000:1.0:1787430968.969792:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:17117:x1874256847880704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.969799:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787430968.969873:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430968.969888:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4600/0x4dbb683ba6a9564b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95652 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.969898:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4600/0x4dbb683ba6a9564b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95652 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430968.969975:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.970002:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.970243:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c2e24ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430968.970281:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880832 00000100:00100000:2.0:1787430968.970298:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880832 00000100:00100000:2.0:1787430968.970324:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787430968.970331:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:17117:x1874256847880832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430968.970526:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:17117:x1874256847880832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430968.970534:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787430968.970595:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.970642:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.970751:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.970817:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c2e24ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.970854:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847880960 00000100:00100000:1.0:1787430968.970859:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847880960 00000100:00100000:1.0:1787430968.970885:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787430968.970893:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:17117:x1874256847880960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430968.971200:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:17117:x1874256847880960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.971208:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787430968.971270:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847880960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430968.972266:0:20252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787430968.972442:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787430968.972463:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430968.972473:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4600/0x4dbb683ba6a9564b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95652 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.972484:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce4600/0x4dbb683ba6a9564b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95652 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430968.972495:0:17117:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430968.972498:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c08afe800 from 13 10000000:01000000:0.0:1787430968.972500:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430968.972525:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5e00/0x4dbb683ba6a95659 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.972534:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5e00/0x4dbb683ba6a95659 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.972542:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5e00/0x4dbb683ba6a95659 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430968.972560:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.972943:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.972983:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02256840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.973096:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847881088 00000100:00100000:1.0:1787430968.973114:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847881088 00000100:00100000:1.0:1787430968.973187:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787430968.973196:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+22:17117:x1874256847881088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430968.973206:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430968.973219:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a95660 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95659 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.973238:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a95660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95659 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.973248:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c360ef200/0x4dbb683ba6a95660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95659 expref: 23 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.973257:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef200, rc 0) 00000100:00100000:1.0:1787430968.973300:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847881088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.973306:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787430968.973371:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430968.973385:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5e00/0x4dbb683ba6a95659 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95660 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.973399:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5e00/0x4dbb683ba6a95659 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a95660 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430968.973451:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.973476:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.974983:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02256840 going to sleep for 11 seconds 00000100:00100000:3.0:1787430968.975387:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847881216 00000100:00100000:3.0:1787430968.975397:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847881216 00000100:00100000:3.0:1787430968.975440:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787430968.975449:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847881216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430968.975586:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847881216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430968.975594:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787430968.976758:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.976826:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.976903:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.976957:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02256840 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.977207:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847881344 00000100:00100000:1.0:1787430968.977214:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847881344 00000100:00100000:1.0:1787430968.977253:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787430968.977262:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847881344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430968.977365:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847881344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.977373:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787430968.977478:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787430968.978494:0:20253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787430968.979230:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787430968.979259:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430968.979270:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5e00/0x4dbb683ba6a95659 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95660 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.979298:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2b03ce5e00/0x4dbb683ba6a95659 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a95660 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430968.979309:0:17117:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430968.979311:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2c3a6a7800 from 13 10000000:01000000:1.0:1787430968.979315:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430968.979346:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a95667 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.979354:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a95667 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.979362:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a95667 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430968.979385:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c315afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430968.979441:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430968.979518:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109eb900 going to sleep for 11 seconds 00000100:00100000:2.0:1787430968.979560:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847881472 00000100:00100000:2.0:1787430968.979568:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847881472 00000100:00100000:2.0:1787430968.982174:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787430968.982196:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+23:17117:x1874256847881472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430968.982214:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430968.982233:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c3bf2ae00/0x4dbb683ba6a9566e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbb683ba6a95667 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430968.982259:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c3bf2ae00/0x4dbb683ba6a9566e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4dbb683ba6a95667 expref: 24 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430968.982270:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c3bf2ae00/0x4dbb683ba6a9566e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4dbb683ba6a95667 expref: 24 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430968.982279:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2ae00, rc 0) 00000100:00100000:2.0:1787430968.982352:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847881472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430968.982359:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787430968.982499:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c315afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430968.982516:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a95667 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9566e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430968.982526:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a95667 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4dbb683ba6a9566e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430968.982591:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.982634:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.982662:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b022560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430968.982754:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847881600 00000100:00100000:2.0:1787430968.982759:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847881600 00000100:00100000:2.0:1787430968.982819:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787430968.982826:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847881600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430968.982943:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847881600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430968.982950:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787430968.982996:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.983026:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430968.983057:0:17117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430968.983663:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b022560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430968.983814:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847881728 00000100:00100000:1.0:1787430968.983818:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847881728 00000100:00100000:1.0:1787430968.983838:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787430968.983845:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847881728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430968.983923:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:17117:x1874256847881728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430968.983938:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787430968.984003:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:17117:1874256847881728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787430968.985062:0:20254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787430968.985199:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787430968.985220:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430968.985228:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a95667 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9566e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430968.985244:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff8e2c360ee800/0x4dbb683ba6a95667 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4dbb683ba6a9566e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430969.085716:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.085800:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289280 00000100:00100000:2.0:1787430969.085811:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289280 00000100:00100000:2.0:1787430969.086073:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 154 00000100:00100000:2.0:1787430969.086086:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+11:14895:x1874256836289280:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430969.086103:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430969.086120:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c3bf2b000/0x4dbb683ba6a95675 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d13 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.086152:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c3bf2b000/0x4dbb683ba6a95675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d13 expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.086164:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c3bf2b000/0x4dbb683ba6a95675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d13 expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.086173:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2b000, rc 0) 00000100:00100000:2.0:1787430969.086241:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:14895:x1874256836289280:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 158us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.086249:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 154 00000100:00100000:0.0:1787430969.088336:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.088436:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289408 00000100:00100000:3.0:1787430969.088453:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289408 00000100:00100000:3.0:1787430969.088536:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:3.0:1787430969.088549:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:14895:x1874256836289408:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430969.088766:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:14895:x1874256836289408:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 220us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.088773:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:3.0:1787430969.090693:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.090989:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289536 00000100:00100000:2.0:1787430969.091007:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289536 00000100:00100000:2.0:1787430969.091087:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:2.0:1787430969.091101:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:14895:x1874256836289536:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430969.091318:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:14895:x1874256836289536:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 220us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.091346:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:0.0:1787430969.098219:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430969.098856:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289664 00000100:00100000:1.0:1787430969.098869:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289664 00000100:00100000:3.0:1787430969.098976:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:3.0:1787430969.098994:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+12:14895:x1874256836289664:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430969.099114:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430969.099140:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a9567c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d1a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.099179:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a9567c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d1a expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.099193:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2c35e8be00/0x4dbb683ba6a9567c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d1a expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.099266:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8be00, rc 0) 00000100:00100000:3.0:1787430969.099469:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:14895:x1874256836289664:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 479us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.099478:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:0.0:1787430969.102920:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.103120:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289792 00000100:00100000:2.0:1787430969.103136:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289792 00000100:00100000:2.0:1787430969.103305:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 158 00000100:00100000:2.0:1787430969.103317:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:14895:x1874256836289792:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430969.103658:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:14895:x1874256836289792:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 342us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.103665:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 158 00000100:00100000:1.0:1787430969.105694:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.105815:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836289920 00000100:00100000:3.0:1787430969.105828:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836289920 00000100:00100000:3.0:1787430969.105940:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 159 00000100:00100000:3.0:1787430969.105954:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:14895:x1874256836289920:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430969.106167:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b3576db-2a3d-4843-b6be-497e7f68c8ba+13:14895:x1874256836289920:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 215us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.106175:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 159 00010000:00010000:3.0:1787430969.473377:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430969.554235:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.554536:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836290048 00000100:00100000:3.0:1787430969.554550:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836290048 00000100:00100000:3.0:1787430969.555149:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1787430969.555175:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:15561:x1874256836290048:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430969.555215:0:19453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430969.555292:0:19453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a95683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d21 expref: -99 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555413:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555435:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555461:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555486:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555499:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555506:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555729:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b400/0x4dbb683ba6a95698 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555744:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b400/0x4dbb683ba6a95698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555754:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b400/0x4dbb683ba6a95698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430969.555798:0:19453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787430969.555805:0:19453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430969.555860:0:19453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b400/0x4dbb683ba6a95698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555887:0:19453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555894:0:19453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555901:0:19453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555908:0:19453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ae00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430969.555913:0:19453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555930:0:19453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.555945:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:3.0:1787430969.555949:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430969.556080:0:19453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556090:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9568a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556306:0:19453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556314:0:19453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556320:0:19453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556332:0:19453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8bc00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430969.556335:0:19453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556403:0:19453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556415:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e2c1847b400) 00010000:00010000:3.0:1787430969.556417:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430969.556421:0:19453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556426:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95691 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556470:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a95683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d21 expref: 8 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556484:0:19453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b400/0x4dbb683ba6a95698 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d21 expref: 7 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.556491:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:3.0:1787430969.556494:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430969.556496:0:19453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b400, rc 0) 00000100:00100000:3.0:1787430969.556740:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:15561:x1874256836290048:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1572us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.556750:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1787430969.560506:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.560594:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836290176 00000100:00100000:2.0:1787430969.560633:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836290176 00000100:00100000:2.0:1787430969.560760:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1787430969.560775:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:15561:x1874256836290176:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787430969.560904:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:15561:x1874256836290176:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 Request processed in 132us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.560913:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1787430969.562521:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.562737:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836290432 00000100:00100000:0.0:1787430969.562750:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836290432 00000100:00100000:0.0:1787430969.562815:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1787430969.562828:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:15561:x1874256836290432:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430969.562973:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430969.563005:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a9569f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d28 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.563170:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.563189:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.563203:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570087:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570130:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570144:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570277:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a956b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570286:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a956b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570294:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a956b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430969.570306:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787430969.570456:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570464:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570471:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570477:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce4400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.570482:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570490:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570513:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2c1847bd00) 00010000:00010000:0.0:1787430969.570515:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.570520:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570526:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce4400/0x4dbb683ba6a956a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570540:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570546:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570551:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570557:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2b03ce5800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.570559:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570565:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570573:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430969.570575:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.570578:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.570583:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5800/0x4dbb683ba6a956ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.573447:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5600/0x4dbb683ba6a9569f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d28 expref: 10 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.573475:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2b03ce5a00/0x4dbb683ba6a956b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d28 expref: 9 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.573485:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:0.0:1787430969.573489:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.573492:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2b03ce5a00, rc 0) 00000100:00100000:0.0:1787430969.573830:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:15561:x1874256836290432:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 11003us (11318us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787430969.573840:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:1.0:1787430969.587502:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430969.587819:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.587894:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836290560 00000100:00100000:0.0:1787430969.587905:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836290560 00000100:00100000:0.0:1787430969.587974:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836290688 00000100:00100000:0.0:1787430969.587978:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836290688 00000100:00100000:0.0:1787430969.588005:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:0.0:1787430969.588016:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+10:15567:x1874256836290560:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430969.588037:0:19453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430969.588060:0:19453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490200/0x4dbb683ba6a956c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d2f expref: -99 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588127:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588142:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588184:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588201:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588209:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588216:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588267:0:19453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588275:0:19453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588281:0:19453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588287:0:19453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.588293:0:19453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588300:0:19453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588313:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:0.0:1787430969.588316:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.588320:0:19453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588347:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588370:0:19453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588377:0:19453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588382:0:19453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588386:0:19453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491c00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.588389:0:19453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588394:0:19453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588401:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2b03b34400) 00010000:00010000:0.0:1787430969.588404:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.588406:0:19453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588411:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a956d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588443:0:19453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490200/0x4dbb683ba6a956c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d2f expref: 11 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588463:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:0.0:1787430969.588465:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.588469:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490200/0x4dbb683ba6a956c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d2f expref: 11 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.588479:0:19453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01490200, rc 0) 00000100:00100000:0.0:1787430969.588534:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+10:15567:x1874256836290560:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 519us (1043us total) trans 0 rc 301/301 00000100:00100000:0.0:1787430969.588541:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:0.0:1787430969.588562:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:0.0:1787430969.588570:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:15561:x1874256836290688:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787430969.588635:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:15561:x1874256836290688:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 65us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430969.588641:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:1.0:1787430969.590502:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.590570:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836290816 00000100:00100000:0.0:1787430969.590578:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836290816 00000100:00100000:0.0:1787430969.590652:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1787430969.590662:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:15561:x1874256836290816:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787430969.595690:0:19453:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4991us 00000100:00100000:0.0:1787430969.603435:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430969.603586:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836290944 00000100:00100000:1.0:1787430969.603624:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836290944 00000100:00100000:1.0:1787430969.603678:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:1.0:1787430969.603691:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:15567:x1874256836290944:12345-192.168.202.25@tcp:700:lfs.0 00000100:00100000:1.0:1787430969.603780:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:15567:x1874256836290944:12345-192.168.202.25@tcp:700:lfs.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430969.603788:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1787430969.606409:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:15561:x1874256836290816:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 15739us (15904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.606424:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1787430969.609692:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.609830:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836291200 00000100:00100000:3.0:1787430969.609840:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836291200 00000100:00100000:3.0:1787430969.610058:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1787430969.610071:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:15567:x1874256836291200:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:3.0:1787430969.610129:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430969.610172:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a955f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138c9c expref: 9 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.610192:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:3.0:1787430969.610197:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430969.610260:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.610275:0:17121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 5 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.610283:0:17121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.610317:0:17121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 5 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.610331:0:17121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 5 pid: 17121 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430969.610378:0:17121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17121:1874256847881856:192.168.202.25@tcp:104: 00000100:00100000:3.0:1787430969.610463:0:17121:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c091653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430969.614590:0:17121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c3f86c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17121:1874256847881856:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430969.614660:0:17121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430969.615565:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.615674:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836291328 00000100:00100000:2.0:1787430969.615683:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836291328 00010000:00010000:2.0:1787430969.615725:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 6 pid: 17121 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430969.615761:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:2.0:1787430969.615772:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5be954f-625f-494d-992d-9b94f56b0aac+6:2399:x1874256836291328:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430969.615786:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430969.615793:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 6 pid: 17121 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.615824:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 6 pid: 17121 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.615846:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a9562f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d0c expref: 6 pid: 17121 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.615861:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:2.0:1787430969.615866:0:17105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.615875:0:17105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.615882:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.615930:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430969.615990:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5be954f-625f-494d-992d-9b94f56b0aac+5:2399:x1874256836291328:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 219us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.615997:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00010000:00010000:0.0:1787430969.616084:0:17121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.616093:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.616127:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.616137:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.616146:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.618494:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.618518:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.618530:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430969.618549:0:17121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf26559a reply state 00000000e8cf4e2e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.618560:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.618567:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430969.618570:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430969.618574:0:17121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787430969.618581:0:17121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787430969.618589:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.618596:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.619067:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.619073:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8a400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.619078:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.619086:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.619098:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493000) 00010000:00010000:0.0:1787430969.619101:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.619105:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.619111:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a400/0x4dbb683ba6a956d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430969.619132:0:17121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf26559a reply state 00000000e8cf4e2e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.619142:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.619148:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2b03b34400) 00010000:00010000:0.0:1787430969.619150:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430969.619152:0:17121:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787430969.619302:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c315af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+10:15567:x1874256836291200:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 9229us (9696us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787430969.619311:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1787430969.666062:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.666492:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836291456 00000100:00100000:2.0:1787430969.666503:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836291456 00000100:00100000:2.0:1787430969.666658:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:2.0:1787430969.666670:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+10:15575:x1874256836291456:12345-192.168.202.25@tcp:101:lctl.0 00010000:00010000:2.0:1787430969.666695:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430969.666721:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a956ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.666805:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2ac00/0x4dbb683ba6a956f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.666820:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2ac00/0x4dbb683ba6a956f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.666831:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2ac00/0x4dbb683ba6a956f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430969.666885:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787430969.666890:0:17120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430969.666949:0:17120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2ac00/0x4dbb683ba6a956f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.666975:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a956ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d36 expref: 12 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.666993:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2ac00/0x4dbb683ba6a956f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d36 expref: 11 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.667001:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:2.0:1787430969.667004:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430969.667008:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2ac00, rc 0) 00000100:00100000:2.0:1787430969.667072:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+11:15575:x1874256836291456:12345-192.168.202.25@tcp:101:lctl.0 Request processed in 403us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.667079:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:1.0:1787430969.699769:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.701175:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836291584 00000100:00100000:2.0:1787430969.701189:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836291584 00000100:00100000:2.0:1787430969.701260:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:2.0:1787430969.701272:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+5:15576:x1874256836291584:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1787430969.701294:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430969.701317:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a956fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d3d expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.701385:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2aa00/0x4dbb683ba6a95701 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.701399:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2aa00/0x4dbb683ba6a95701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.701411:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2aa00/0x4dbb683ba6a95701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430969.701457:0:17122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787430969.701461:0:17122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430969.701485:0:17122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2aa00/0x4dbb683ba6a95701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.701512:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a956fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d3d expref: 7 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.701545:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2aa00/0x4dbb683ba6a95701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d3d expref: 6 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.701564:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:2.0:1787430969.701574:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430969.701579:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2aa00, rc 0) 00000100:00100000:3.0:1787430969.702264:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+6:15576:x1874256836291584:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 991us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.702274:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1787430969.704399:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.704443:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836291712 00000100:00100000:3.0:1787430969.704452:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836291712 00000100:00100000:3.0:1787430969.704570:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:3.0:1787430969.704581:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5be954f-625f-494d-992d-9b94f56b0aac+6:15576:x1874256836291712:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430969.704636:0:19453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430969.704654:0:19453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d44 expref: -99 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704710:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704723:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704733:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704742:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704759:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704766:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704839:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a9571d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704857:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a9571d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704864:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a9571d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430969.704899:0:19453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787430969.704903:0:19453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430969.704952:0:19453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a9571d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704964:0:19453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704971:0:19453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704978:0:19453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.704984:0:19453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ae00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430969.704988:0:19453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705001:0:19453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705014:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:3.0:1787430969.705016:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430969.705020:0:19453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705027:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9570f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705039:0:19453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705046:0:19453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705052:0:19453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705057:0:19453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430969.705060:0:19453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705065:0:19453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705071:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2b03b34400) 00010000:00010000:3.0:1787430969.705073:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430969.705075:0:19453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705089:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95716 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705114:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d44 expref: 8 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705126:0:19453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a9571d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d44 expref: 7 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.705145:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:3.0:1787430969.705147:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430969.705150:0:19453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8b600, rc 0) 00000100:00100000:3.0:1787430969.705201:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5be954f-625f-494d-992d-9b94f56b0aac+7:15576:x1874256836291712:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 622us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.705208:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:1.0:1787430969.707375:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.707425:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836291840 00000100:00100000:0.0:1787430969.707433:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836291840 00000100:00100000:0.0:1787430969.707519:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1787430969.707538:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f5be954f-625f-494d-992d-9b94f56b0aac+5:15576:x1874256836291840:12345-192.168.202.25@tcp:900:lfs.0 00000100:00100000:0.0:1787430969.707830:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f5be954f-625f-494d-992d-9b94f56b0aac+5:15576:x1874256836291840:12345-192.168.202.25@tcp:900:lfs.0 Request processed in 293us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430969.707838:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1787430969.711151:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.711204:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836292096 00000100:00100000:0.0:1787430969.711215:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836292096 00000100:00100000:0.0:1787430969.711318:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:0.0:1787430969.711330:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+7:15576:x1874256836292096:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430969.711351:0:17121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430969.711372:0:17121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a95724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d4b expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430969.711474:0:17121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787430969.711591:0:17121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a95724 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d4b expref: 9 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.711647:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:0.0:1787430969.711650:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430969.711656:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a95724 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d4b expref: 9 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.711670:0:17121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491a00, rc 0) 00000100:00100000:0.0:1787430969.711748:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5be954f-625f-494d-992d-9b94f56b0aac+8:15576:x1874256836292096:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 419us (671us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787430969.711772:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:1.0:1787430969.714663:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.714763:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836292352 00000100:00100000:2.0:1787430969.714781:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836292352 00000100:00100000:2.0:1787430969.714885:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:2.0:1787430969.714896:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5be954f-625f-494d-992d-9b94f56b0aac+8:15576:x1874256836292352:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:2.0:1787430969.714955:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430969.714985:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8b600/0x4dbb683ba6a9571d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d44 expref: 8 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.715006:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:2.0:1787430969.715010:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430969.715031:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.715043:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.715052:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430969.715280:0:17120:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003acd4367 reply state 0000000022240dfc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.715291:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.715297:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:2.0:1787430969.715299:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787430969.715302:0:17120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787430969.715310:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787430969.715395:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5be954f-625f-494d-992d-9b94f56b0aac+9:15576:x1874256836292352:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 501us (742us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787430969.715402:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1787430969.723330:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.723635:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836292608 00000100:00100000:0.0:1787430969.723645:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836292608 00000100:00100000:0.0:1787430969.723696:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:0.0:1787430969.723707:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5be954f-625f-494d-992d-9b94f56b0aac+9:15576:x1874256836292608:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430969.723932:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5be954f-625f-494d-992d-9b94f56b0aac+10:15576:x1874256836292608:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 213us (601us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787430969.723941:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1787430969.727098:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.727356:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836292864 00000100:00100000:3.0:1787430969.727368:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836292864 00000100:00100000:3.0:1787430969.727430:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:3.0:1787430969.727441:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+10:15576:x1874256836292864:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430969.727467:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430969.727491:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d52 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727566:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727581:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727633:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727648:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727656:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727663:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430969.727761:0:17122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787430969.727839:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727846:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727852:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727858:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ac00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430969.727862:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727868:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727880:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:3.0:1787430969.727882:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430969.727893:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727899:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a95740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727912:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727919:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727936:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727941:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ae00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430969.727944:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727950:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727958:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2b03b34400) 00010000:00010000:3.0:1787430969.727960:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430969.727963:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.727969:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a95747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.728000:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95739 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d52 expref: 12 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.728016:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:3.0:1787430969.728018:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430969.728020:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d52 expref: 12 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.728027:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8bc00, rc 0) 00000100:00100000:3.0:1787430969.728084:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5be954f-625f-494d-992d-9b94f56b0aac+11:15576:x1874256836292864:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 646us (1008us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787430969.728092:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:1.0:1787430969.730914:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.735199:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836292992 00000100:00100000:3.0:1787430969.735217:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836292992 00000100:00100000:0.0:1787430969.735571:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:0.0:1787430969.735584:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5be954f-625f-494d-992d-9b94f56b0aac+11:15576:x1874256836292992:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430969.735638:0:19453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430969.735661:0:19453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a95755 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d59 expref: -99 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.735762:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.735777:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.735789:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430969.735814:0:19453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430969.735818:0:19453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430969.735838:0:19453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.735886:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a95755 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 13 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.735910:0:19453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 12 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.735918:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430969.735933:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430969.735937:0:19453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491e00, rc 0) 00000100:00100000:0.0:1787430969.736078:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5be954f-625f-494d-992d-9b94f56b0aac+12:15576:x1874256836292992:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 495us (5173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430969.736085:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:1.0:1787430969.739025:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.739125:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836293120 00000100:00100000:0.0:1787430969.739137:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836293120 00000100:00100000:0.0:1787430969.739246:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:0.0:1787430969.739257:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5be954f-625f-494d-992d-9b94f56b0aac+12:15576:x1874256836293120:12345-192.168.202.25@tcp:37:lfs.0 00000100:00100000:0.0:1787430969.746590:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5be954f-625f-494d-992d-9b94f56b0aac+12:15576:x1874256836293120:12345-192.168.202.25@tcp:37:lfs.0 Request processed in 7322us (7563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430969.746645:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:1.0:1787430969.752536:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.752638:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836293376 00000100:00100000:2.0:1787430969.752648:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836293376 00000100:00100000:2.0:1787430969.752701:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:2.0:1787430969.752713:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35cd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f5be954f-625f-494d-992d-9b94f56b0aac+12:15576:x1874256836293376:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430969.753093:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35cd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f5be954f-625f-494d-992d-9b94f56b0aac+13:15576:x1874256836293376:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 380us (564us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787430969.753102:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1787430969.785674:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.785751:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836293504 00000100:00100000:0.0:1787430969.785764:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836293504 00000100:00100000:0.0:1787430969.785887:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:0.0:1787430969.785901:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+11:15582:x1874256836293504:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430969.785950:0:17121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430969.785971:0:17121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a95763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d60 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786034:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786049:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786060:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786071:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786078:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786084:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786159:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a95778 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786168:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a95778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786176:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a95778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430969.786207:0:17121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787430969.786216:0:17121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430969.786254:0:17121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a95778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786267:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786273:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786280:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786286:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.786291:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786298:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786322:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:0.0:1787430969.786326:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.786390:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786399:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9576a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786412:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786419:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786434:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786439:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.786442:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786448:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786456:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2b03b34400) 00010000:00010000:0.0:1787430969.786458:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.786461:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786466:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95771 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786491:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a95763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d60 expref: 13 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786504:0:17121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491200/0x4dbb683ba6a95778 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d60 expref: 12 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.786512:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430969.786514:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787430969.786517:0:17121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491200, rc 0) 00000100:00100000:0.0:1787430969.786595:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+12:15582:x1874256836293504:12345-192.168.202.25@tcp:101:bash.0 Request processed in 698us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430969.786655:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:1.0:1787430969.788383:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.788473:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836293632 00000100:00100000:2.0:1787430969.788482:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836293632 00000100:00100000:2.0:1787430969.788545:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1787430969.788556:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:15582:x1874256836293632:12345-192.168.202.25@tcp:900:bash.0 00000100:00100000:2.0:1787430969.788645:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:15582:x1874256836293632:12345-192.168.202.25@tcp:900:bash.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.788653:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1787430969.791774:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.791842:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836293888 00000100:00100000:0.0:1787430969.791853:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836293888 00000100:00100000:0.0:1787430969.791917:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:0.0:1787430969.791939:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+12:15582:x1874256836293888:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1787430969.791959:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430969.791981:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a9577f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d67 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.792097:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.792114:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 12 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.792124:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.792158:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 12 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.792172:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 12 pid: 19453 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430969.792187:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847881984:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430969.792277:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b022560c0 going to sleep for 11 seconds 00000040:00080000:2.0:1787430969.793294:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787430969.794822:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.795347:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836294016 00000100:00100000:3.0:1787430969.795357:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836294016 00010000:00010000:3.0:1787430969.795398:0:18650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 13 pid: 19453 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430969.795440:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:3.0:1787430969.795450:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5be954f-625f-494d-992d-9b94f56b0aac+13:2400:x1874256836294016:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430969.795466:0:18650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430969.795474:0:18650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 13 pid: 19453 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.795489:0:18650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 13 pid: 19453 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.795513:0:18650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:3.0:1787430969.795541:0:18650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.795552:0:18650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.795559:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.795579:0:18650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430969.795667:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5be954f-625f-494d-992d-9b94f56b0aac+13:2400:x1874256836294016:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 219us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.795676:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00010000:00010000:0.0:1787430969.796506:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a9575c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d59 expref: 12 pid: 19453 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430969.796650:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847881984:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430969.796673:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.796683:0:17120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.796801:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.796856:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.796869:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.796878:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797372:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797382:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797402:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430969.797413:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787430969.797438:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797455:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797461:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797467:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.797472:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797480:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797492:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:0.0:1787430969.797495:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430969.797500:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797505:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a95786 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430969.797517:0:17120:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d615a3b reply state 0000000095a1afe2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.797526:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.800067:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e2b03b34f00) 00010000:00010000:0.0:1787430969.800071:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787430969.800078:0:17120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787430969.800140:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a9577f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 15 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.800179:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 14 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.800186:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:0.0:1787430969.800189:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787430969.800191:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491c00, rc 0) 00000100:00100000:0.0:1787430969.800267:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+15:15582:x1874256836293888:12345-192.168.202.25@tcp:101:bash.0 Request processed in 8331us (8500us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787430969.800276:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:1.0:1787430969.824569:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.824796:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836294144 00000100:00100000:3.0:1787430969.824806:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836294144 00000100:00100000:3.0:1787430969.824881:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:3.0:1787430969.824892:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+15:15582:x1874256836294144:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1787430969.824918:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430969.824950:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a957a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d6e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.825021:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.825036:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.825049:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430969.825316:0:17122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787430969.825368:0:17122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787430969.825412:0:17122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.825424:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.825449:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a957a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 17 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.825468:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 16 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.825476:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:3.0:1787430969.825479:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430969.825483:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ae00, rc 0) 00000100:00100000:3.0:1787430969.825594:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+16:15582:x1874256836294144:12345-192.168.202.25@tcp:101:bash.0 Request processed in 703us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430969.826242:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:1.0:1787430969.832358:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.832486:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836294400 00000100:00100000:0.0:1787430969.832498:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836294400 00000100:00100000:0.0:1787430969.832646:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:0.0:1787430969.832656:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+16:15582:x1874256836294400:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:0.0:1787430969.832895:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+17:15582:x1874256836294400:12345-192.168.202.25@tcp:35:bash.0 Request processed in 240us (556us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787430969.832903:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1787430969.898255:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.900418:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836294656 00000100:00100000:3.0:1787430969.900432:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836294656 00000100:00100000:3.0:1787430969.900504:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:3.0:1787430969.900515:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+17:15592:x1874256836294656:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1787430969.900541:0:19453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430969.900563:0:19453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a957b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d75 expref: -99 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430969.901403:0:19453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787430969.901697:0:19453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a957b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d75 expref: 19 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.901719:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2c11493800) 00010000:00010000:3.0:1787430969.901722:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430969.901727:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a957b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d75 expref: 19 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430969.901742:0:19453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8bc00, rc 0) 00000100:00100000:3.0:1787430969.904148:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+18:15592:x1874256836294656:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 3624us (5890us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787430969.904159:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:1.0:1787430969.907729:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430969.907811:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836294912 00000100:00100000:3.0:1787430969.907821:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836294912 00000100:00100000:3.0:1787430969.907878:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:3.0:1787430969.907888:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+18:15592:x1874256836294912:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1787430969.908131:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+19:15592:x1874256836294912:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 243us (412us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787430969.908138:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1787430969.947370:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.947496:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836295168 00000100:00100000:0.0:1787430969.947505:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836295168 00000100:00100000:0.0:1787430969.947569:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:0.0:1787430969.947581:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+19:15595:x1874256836295168:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1787430969.947631:0:17121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430969.947654:0:17121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d7c expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.947769:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a957c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.947794:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a957c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.947803:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a957c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430969.947814:0:17121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787430969.947933:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d7c expref: 22 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.947953:0:17121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a957c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d7c expref: 21 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.947963:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:0.0:1787430969.947966:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430969.947970:0:17121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491400, rc 0) 00000100:00100000:0.0:1787430969.948031:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+21:15595:x1874256836295168:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 453us (673us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787430969.948036:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:1.0:1787430969.952722:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430969.952764:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430969.952847:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836295424 00000100:00100000:2.0:1787430969.952857:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836295424 00000100:00100000:2.0:1787430969.952937:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:2.0:1787430969.952949:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+21:2402:x1874256836295424:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430969.952966:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430969.952994:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491400/0x4dbb683ba6a957c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d7c expref: 21 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430969.953029:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430969.953034:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430969.953097:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:2402:x1874256836295424:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 150us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430969.953104:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:0.0:1787430969.953479:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836295296 00000100:00100000:0.0:1787430969.953485:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836295296 00000100:00100000:0.0:1787430969.953522:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:0.0:1787430969.953530:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:15595:x1874256836295296:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:0.0:1787430969.953586:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953627:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953651:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953687:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953694:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953700:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953705:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491e00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:0.0:1787430969.953710:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953717:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953726:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:0.0:1787430969.953729:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430969.953733:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430969.953740:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430969.953790:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:15595:x1874256836295296:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 261us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430969.953797:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:1.0:1787430969.956458:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430969.956529:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836295680 00000100:00100000:0.0:1787430969.956538:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836295680 00000100:00100000:0.0:1787430969.956597:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1787430969.956640:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:15595:x1874256836295680:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1787430969.956857:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+21:15595:x1874256836295680:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 220us (407us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787430969.956862:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1787430970.196063:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.196133:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836295936 00000100:00100000:3.0:1787430970.196143:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836295936 00000100:00100000:3.0:1787430970.196216:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:3.0:1787430970.196237:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+21:15626:x1874256836295936:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:3.0:1787430970.196261:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430970.196282:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a957da lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d83 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787430970.196309:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430970.196454:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a957e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.196476:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a957e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.196484:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a957e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430970.196492:0:17122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787430970.196743:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a957da lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d83 expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.196758:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a957e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d83 expref: 23 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.196764:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:3.0:1787430970.196766:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430970.196768:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ac00, rc 0) 00000100:00100000:2.0:1787430970.196905:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+23:15626:x1874256836295936:12345-192.168.202.25@tcp:101:cat.0 Request processed in 678us (850us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787430970.196913:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:1.0:1787430970.199944:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.200100:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836296192 00000100:00100000:0.0:1787430970.200109:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836296192 00000100:00100000:0.0:1787430970.200158:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1787430970.200169:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+23:15626:x1874256836296192:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:0.0:1787430970.200457:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+24:15626:x1874256836296192:12345-192.168.202.25@tcp:35:cat.0 Request processed in 290us (521us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787430970.200465:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:1.0:1787430970.200728:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.200893:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836296320 00000100:00100000:0.0:1787430970.200898:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836296320 00000100:00100000:0.0:1787430970.200946:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:0.0:1787430970.200954:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+24:2400:x1874256836296320:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430970.200987:0:18650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430970.201011:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ac00/0x4dbb683ba6a957e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d83 expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.201029:0:18650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:0.0:1787430970.201033:0:18650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430970.201070:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+23:2400:x1874256836296320:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 116us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430970.201088:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:1.0:1787430970.260488:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.260717:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836296576 00000100:00100000:0.0:1787430970.260729:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836296576 00000100:00100000:0.0:1787430970.260888:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1787430970.260899:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+23:15632:x1874256836296576:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:0.0:1787430970.260947:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430970.260969:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d8a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.261116:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.261132:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 24 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.261140:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.261147:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.261182:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.261196:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 24 pid: 17122 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430970.261210:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847882112:192.168.202.25@tcp:104: 00010000:00010000:0.0:1787430970.261402:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 24 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.261412:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 24 pid: 17120 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430970.261421:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2c35d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847882240:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430970.261453:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b02256300 going to sleep for 11 seconds 00000100:00100000:3.0:1787430970.263676:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.263760:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836296704 00000100:00100000:2.0:1787430970.263769:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836296704 00010000:00010000:2.0:1787430970.263807:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 25 pid: 17122 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.263858:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1787430970.263870:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+25:2399:x1874256836296704:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430970.263882:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430970.263890:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 25 pid: 17122 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.263903:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 25 pid: 17122 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.263934:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.263940:0:17105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.263948:0:17105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.263955:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430970.264005:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+25:2399:x1874256836296704:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 138us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.264013:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00010000:00010000:0.0:1787430970.264582:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a957a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d6e expref: 24 pid: 17122 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430970.264638:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847882112:192.168.202.25@tcp:104: 00000100:00100000:0.0:1787430970.265395:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.265414:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2c35d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847882240:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430970.265438:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430970.265495:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836296832 00000100:00100000:3.0:1787430970.265500:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836296832 00010000:00010000:3.0:1787430970.265523:0:18650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 24 pid: 17120 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430970.265558:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:3.0:1787430970.265567:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c36174c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+24:2399:x1874256836296832:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430970.265578:0:18650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430970.265584:0:18650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 24 pid: 17120 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.265627:0:18650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 24 pid: 17120 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.265642:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a95794 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d67 expref: 24 pid: 17120 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.265651:0:18650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:3.0:1787430970.265654:0:18650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.265660:0:18650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.265665:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.265682:0:18650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430970.265713:0:17120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430970.265719:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c36174c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+23:2399:x1874256836296832:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 153us (325us total) trans 0 rc 0/0 00010000:00010000:1.0:1787430970.265721:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430970.265725:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000004:00200000:1.0:1787430970.265744:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787430970.265888:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a957ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d8a expref: 24 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.266223:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491a00/0x4dbb683ba6a957f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d8a expref: 23 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.266233:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:1.0:1787430970.266236:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430970.266238:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491a00, rc 0) 00000100:00100000:1.0:1787430970.266281:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+23:15632:x1874256836296576:12345-192.168.202.25@tcp:101:dd.0 Request processed in 5384us (5803us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787430970.266289:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1787430970.268693:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.268761:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836296960 00000100:00100000:3.0:1787430970.268769:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836296960 00000100:00100000:3.0:1787430970.268819:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:3.0:1787430970.268828:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+23:15632:x1874256836296960:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1787430970.268856:0:17121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430970.268874:0:17121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95804 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d91 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.268933:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.268945:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.268954:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.269063:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95804 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 25 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.269092:0:17121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 24 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.269101:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:3.0:1787430970.269105:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430970.269108:0:17121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8a000, rc 0) 00000100:00100000:3.0:1787430970.269158:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+24:15632:x1874256836296960:12345-192.168.202.25@tcp:101:dd.0 Request processed in 330us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430970.269165:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:2.0:1787430970.276322:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.278240:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836297216 00000100:00100000:3.0:1787430970.278253:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836297216 00000100:00100000:2.0:1787430970.278394:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:2.0:1787430970.278403:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+24:15632:x1874256836297216:12345-192.168.202.25@tcp:36:dd.0 00010000:00010000:2.0:1787430970.278620:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.278638:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.278650:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430970.278689:0:19453:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787430970.278706:0:19453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044240174 reply state 00000000047e679c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.278715:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.278720:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.278722:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787430970.278725:0:19453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430970.278804:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+27:15632:x1874256836297216:12345-192.168.202.25@tcp:36:dd.0 Request processed in 402us (2491us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787430970.278812:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000020:00080000:2.0:1787430970.278817:0:19453:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787430970.281741:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.281796:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836297344 00000100:00100000:2.0:1787430970.281805:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836297344 00000100:00100000:2.0:1787430970.281863:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1787430970.281873:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+27:15632:x1874256836297344:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:2.0:1787430970.281933:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430970.281956:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95819 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d98 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.282007:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95819 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d98 expref: 28 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.282021:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95819 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d98 expref: 28 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.282038:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.282041:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430970.282043:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2b800, rc 0) 00000100:00100000:2.0:1787430970.282102:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+28:15632:x1874256836297344:12345-192.168.202.25@tcp:101:dd.0 Request processed in 230us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.282110:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:0.0:1787430970.295707:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.296001:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836297600 00000100:00100000:2.0:1787430970.296011:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836297600 00000100:00100000:2.0:1787430970.296108:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:2.0:1787430970.296119:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+28:15632:x1874256836297600:12345-192.168.202.25@tcp:103:dd.0 00010000:00010000:2.0:1787430970.296136:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430970.296160:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95819 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d98 expref: 28 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.296179:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.296184:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430970.296244:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+27:15632:x1874256836297600:12345-192.168.202.25@tcp:103:dd.0 Request processed in 127us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.296265:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:0.0:1787430970.300700:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.300811:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836297728 00000100:00100000:1.0:1787430970.300822:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836297728 00000100:00100000:1.0:1787430970.300881:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:1.0:1787430970.300892:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+27:15632:x1874256836297728:12345-192.168.202.25@tcp:58:dd.0 00010000:00010000:1.0:1787430970.301025:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.301044:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.301318:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430970.302490:0:17120:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430970.302740:0:17120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787430970.302844:0:17120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787430970.302944:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+27:15632:x1874256836297728:12345-192.168.202.25@tcp:58:dd.0 Request processed in 2049us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430970.302953:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:0.0:1787430970.304959:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.311566:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836297856 00000100:00100000:3.0:1787430970.311579:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836297856 00000100:00100000:3.0:1787430970.311654:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:3.0:1787430970.311665:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+27:15632:x1874256836297856:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:2.0:1787430970.311831:0:17121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430970.311855:0:17121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138d9f expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.311937:0:17121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.311949:0:17121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 28 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.311969:0:17121:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.311983:0:17121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 28 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.311996:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.311998:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430970.312001:0:17121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 28 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.312007:0:17121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2b800, rc 0) 00000100:00100000:2.0:1787430970.312075:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+28:15632:x1874256836297856:12345-192.168.202.25@tcp:101:dd.0 Request processed in 412us (7129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.312082:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00010000:00010000:1.0:1787430970.496021:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430970.624446:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787430970.817394:0:17154:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787430970.817404:0:17154:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430970.817437:0:17154:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787430970.817447:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787430970.817593:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17154:1874256847882368:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430970.817731:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430970.822702:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.822819:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836297984 00000100:00100000:3.0:1787430970.822828:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836297984 00000100:00100000:3.0:1787430970.822893:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:3.0:1787430970.822922:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+29:15633:x1874256836297984:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430970.822965:0:19453:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787430970.823066:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17154:1874256847882368:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430970.823094:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+28:15633:x1874256836297984:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 182us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430970.823104:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:0.0:1787430970.828263:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.829345:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836298112 00000100:00100000:2.0:1787430970.829357:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836298112 00000100:00100000:2.0:1787430970.829429:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:2.0:1787430970.829441:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+28:15633:x1874256836298112:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787430970.829518:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829535:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829548:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829584:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829592:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829627:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829658:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829687:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829694:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430970.829751:0:17122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787430970.829756:0:17122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787430970.829773:0:17122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829784:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829790:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829797:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829803:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.829808:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829815:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829828:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:2.0:1787430970.829831:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.829836:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829852:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9582e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829867:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829873:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829879:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829884:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.829887:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829894:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829901:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e2c11493500) 00010000:00010000:2.0:1787430970.829904:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.829906:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829921:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95835 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829936:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829942:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829955:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829959:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2bc00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.829962:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829967:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829975:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.829978:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.829980:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.829985:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9583c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.830077:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+28:15633:x1874256836298112:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 638us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.830085:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:0.0:1787430970.836287:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.836407:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836298368 00000100:00100000:3.0:1787430970.836418:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836298368 00000100:00100000:3.0:1787430970.836540:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1787430970.836553:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+28:15633:x1874256836298368:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430970.836574:0:19453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430970.836598:0:19453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95843 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138da6 expref: -99 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836748:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836764:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836776:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430970.836787:0:19453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787430970.836875:0:19453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836897:0:19453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836904:0:19453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836922:0:19453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8ae00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:3.0:1787430970.836928:0:19453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836937:0:19453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836950:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:3.0:1787430970.836953:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787430970.836957:0:19453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.836963:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a9584a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.837003:0:19453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95843 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138da6 expref: 30 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.837013:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2b03b34a00) 00010000:00010000:3.0:1787430970.837016:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430970.837019:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a95843 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138da6 expref: 30 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.837029:0:19453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8bc00, rc 0) 00000100:00100000:3.0:1787430970.837095:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+29:15633:x1874256836298368:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 545us (821us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787430970.837102:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1787430970.843397:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.843525:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836298496 00000100:00100000:2.0:1787430970.843536:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836298496 00000100:00100000:2.0:1787430970.843630:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:2.0:1787430970.843641:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+29:15633:x1874256836298496:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787430970.843677:0:17122:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787430970.843791:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+29:15633:x1874256836298496:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 152us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.843816:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:0.0:1787430970.852640:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.852782:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836298752 00000100:00100000:1.0:1787430970.852791:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836298752 00000100:00100000:1.0:1787430970.853546:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:1.0:1787430970.853560:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+29:15633:x1874256836298752:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430970.853583:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430970.853621:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95858 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138dad expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430970.853986:0:17120:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1787430970.853993:0:17120:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787430970.854013:0:17120:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787430970.854219:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee600/0x4dbb683ba6a9585f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.854234:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee600/0x4dbb683ba6a9585f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.854244:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee600/0x4dbb683ba6a9585f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.854297:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95858 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dad expref: 32 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.854315:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee600/0x4dbb683ba6a9585f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dad expref: 31 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.854344:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2b03540f00) 00010000:00010000:1.0:1787430970.854347:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430970.854350:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ee600, rc 0) 00000100:00100000:1.0:1787430970.854415:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+31:15633:x1874256836298752:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 858us (1814us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787430970.854422:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:0.0:1787430970.857948:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.858234:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836299008 00000100:00100000:2.0:1787430970.858244:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836299008 00000100:00100000:2.0:1787430970.858385:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1787430970.858397:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+31:15633:x1874256836299008:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787430970.858453:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430970.858476:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee600/0x4dbb683ba6a9585f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dad expref: 31 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858490:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2b03540f00) 00010000:00010000:2.0:1787430970.858497:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430970.858514:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858524:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858531:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858578:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858583:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858587:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858670:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858677:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858683:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858689:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2bc00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.858693:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858700:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858708:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:2.0:1787430970.858711:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.858715:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858721:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2bc00/0x4dbb683ba6a9586d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858731:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858737:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858743:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858754:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.858758:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858763:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858769:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1615a3f8 (ffff8e2c11493500) 00010000:00010000:2.0:1787430970.858771:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.858772:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.858776:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a400/0x4dbb683ba6a95874 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1615a3f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.858853:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+30:15633:x1874256836299008:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 457us (913us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787430970.858859:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:3.0:1787430970.861072:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.861120:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836299136 00000100:00100000:2.0:1787430970.861129:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836299136 00000100:00100000:2.0:1787430970.861185:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:2.0:1787430970.861195:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+30:15633:x1874256836299136:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430970.861214:0:19453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430970.861236:0:19453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9587b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138db4 expref: -99 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.861268:0:19453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b400/0x4dbb683ba6a95882 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.861295:0:19453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b400/0x4dbb683ba6a95882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.861305:0:19453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b400/0x4dbb683ba6a95882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.861407:0:19453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a800/0x4dbb683ba6a9587b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138db4 expref: 32 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.861424:0:19453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b400/0x4dbb683ba6a95882 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138db4 expref: 31 pid: 19453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.861431:0:19453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:2.0:1787430970.861434:0:19453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430970.861437:0:19453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2b400, rc 0) 00000100:00100000:2.0:1787430970.861490:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+31:15633:x1874256836299136:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 295us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.861497:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1787430970.864134:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.864208:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836299392 00000100:00100000:1.0:1787430970.864215:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836299392 00000100:00100000:1.0:1787430970.864262:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1787430970.864274:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+31:15633:x1874256836299392:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430970.864351:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.864366:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.864376:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430970.864529:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787430970.864535:0:17122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 432336933458ns, next at 433336932043ns, rc = 0 00000004:00010000:1.0:1787430970.864575:0:17122:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e46d3ca reply state 0000000017cb9b3b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.864585:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.864590:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:1.0:1787430970.864636:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787430970.864640:0:17122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430970.865355:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+33:15633:x1874256836299392:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 1079us (1226us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787430970.865364:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:0.0:1787430970.866888:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.867065:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836299520 00000100:00100000:1.0:1787430970.867072:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836299520 00000100:00100000:1.0:1787430970.867117:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:1.0:1787430970.867127:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+33:15633:x1874256836299520:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430970.867148:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430970.867166:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138dbb expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.867211:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 34 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.867224:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 34 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.867240:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:1.0:1787430970.867243:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430970.867246:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c360ef800, rc 0) 00000100:00100000:1.0:1787430970.867342:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+34:15633:x1874256836299520:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 209us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430970.867349:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:3.0:1787430970.870065:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.870838:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836299648 00000100:00100000:1.0:1787430970.870849:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836299648 00000100:00100000:1.0:1787430970.870933:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:1.0:1787430970.870958:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2399:x1874256836299648:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787430970.870982:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430970.871202:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2399:x1874256836299648:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 245us (1146us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787430970.871210:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:0.0:1787430970.885667:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.885770:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836299904 00000100:00100000:3.0:1787430970.885779:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836299904 00000100:00100000:3.0:1787430970.885841:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:3.0:1787430970.885851:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+34:15633:x1874256836299904:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787430970.886098:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+35:15633:x1874256836299904:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 248us (442us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787430970.886106:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1787430970.893923:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.894050:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836300160 00000100:00100000:2.0:1787430970.894062:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836300160 00000100:00100000:2.0:1787430970.894126:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:2.0:1787430970.894136:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+35:15633:x1874256836300160:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787430970.894248:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+35:15633:x1874256836300160:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.894256:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:1.0:1787430970.899478:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.899575:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836300288 00000100:00100000:0.0:1787430970.899586:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836300288 00000100:00100000:0.0:1787430970.899679:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1787430970.899693:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+35:15633:x1874256836300288:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430970.899720:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430970.899746:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a95897 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138dc2 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.899827:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a9589e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.899842:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a9589e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.899850:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a9589e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430970.899888:0:17120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787430970.899903:0:17120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a9589e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.899945:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a95897 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc2 expref: 37 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.899966:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a9589e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc2 expref: 36 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.899975:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:0.0:1787430970.899978:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787430970.899999:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c01491c00, rc 0) 00000100:00100000:0.0:1787430970.900229:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+36:15633:x1874256836300288:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 539us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430970.900237:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1787430970.911293:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.911569:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836300416 00000100:00100000:2.0:1787430970.911597:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836300416 00000100:00100000:2.0:1787430970.911713:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1787430970.911725:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+6:2399:x1874256836300416:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430970.911752:0:18623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430970.911782:0:18623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138dc9 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430970.911811:0:18623:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a083a, blocks: 0x0 00010000:00010000:2.0:1787430970.911831:0:18623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1787430970.911837:0:18623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430970.911847:0:18623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 7 pid: 18623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.911869:0:18623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 7 pid: 18623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.911883:0:18623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2a400, rc 0) 00000100:00100000:2.0:1787430970.912031:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2399:x1874256836300416:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 308us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.912039:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1787430970.921485:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.921695:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836300672 00000100:00100000:0.0:1787430970.921705:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836300672 00000100:00100000:0.0:1787430970.921807:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:0.0:1787430970.921818:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+36:15633:x1874256836300672:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787430970.921951:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+36:15633:x1874256836300672:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 134us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430970.921959:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:1.0:1787430970.924129:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.924225:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836300800 00000100:00100000:2.0:1787430970.924235:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836300800 00000100:00100000:2.0:1787430970.924288:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:2.0:1787430970.924298:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+36:15633:x1874256836300800:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787430970.926488:0:17100:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787430970.926506:0:17100:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787430970.926704:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430970.926725:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847882496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787430970.926798:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430970.926862:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847882496 00000100:00100000:1.0:1787430970.926868:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847882496 00000100:00100000:1.0:1787430970.926930:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430970.926942:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874256847882496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787430970.927069:0:18622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787430970.927072:0:18622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787430970.927075:0:18622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787430970.927077:0:18622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787430970 -> 1787430970 00002000:00010000:1.0:1787430970.927079:0:18622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787430970.927119:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3630:x1874256847882496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (320us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787430970.927126:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430970.927165:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787430970.927184:0:3630:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8e2b04c39180 x1874256847882496/t8589934596(8589934596) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787430986 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787430970.927195:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2b04c39180/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787430970.927200:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1874256847882496:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787430970.927235:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787430970.927318:0:17100:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787430970.927489:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+19:15633:x1874256836300800:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 3190us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430970.927497:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00010000:00010000:2.0:1787430970.928203:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928219:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928228:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928235:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491800 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.928240:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928248:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928267:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2b03b34400) 00010000:00010000:2.0:1787430970.928270:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.928275:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928282:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491800/0x4dbb683ba6a956de lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928304:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928310:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928316:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928321:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01490000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.928339:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928346:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928354:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:2.0:1787430970.928356:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.928359:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928366:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01490000/0x4dbb683ba6a956e5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928382:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928390:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928401:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928406:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.928409:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928415:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928422:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e2b03b34f00) 00010000:00010000:2.0:1787430970.928424:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.928434:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928440:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491600/0x4dbb683ba6a9578d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928456:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928462:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928467:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928472:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2be00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.928475:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928480:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928488:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.928491:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.928494:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928499:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2be00/0x4dbb683ba6a95812 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928511:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928525:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928532:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928537:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360ee400 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.928540:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928547:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928556:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:2.0:1787430970.928558:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430970.928561:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.928566:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ee400/0x4dbb683ba6a95889 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.930086:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.930102:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.930109:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.930115:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a000 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:1.0:1787430970.930119:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.930126:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.930138:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2b03b34d00) 00010000:00010000:1.0:1787430970.930141:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787430970.930145:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.930151:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a000/0x4dbb683ba6a95732 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.930529:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.930745:0:19072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836300928 00000100:00100000:3.0:1787430970.930755:0:19072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836300928 00000100:00100000:2.0:1787430970.930968:0:19072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:2.0:1787430970.930981:0:19072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2401:x1874256836300928:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787430970.931118:0:19072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2401:x1874256836300928:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 139us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.931125:0:19072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1787430970.933076:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.933201:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836301184 00000100:00100000:1.0:1787430970.933209:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836301184 00000100:00100000:1.0:1787430970.933260:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:1.0:1787430970.933283:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+15:15633:x1874256836301184:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430970.933332:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430970.933367:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491c00/0x4dbb683ba6a9589e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc2 expref: 15 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.933388:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:1.0:1787430970.933392:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430970.933422:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a958ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.933437:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a958ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.933447:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a958ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430970.933590:0:17122:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7d11f97 reply state 000000009daa9edd transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a958ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.933624:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eea00/0x4dbb683ba6a958ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.933631:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:1.0:1787430970.933634:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787430970.933637:0:17122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430970.933776:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+16:15633:x1874256836301184:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 494us (706us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787430970.933784:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:3.0:1787430970.935932:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.936121:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836301312 00000100:00100000:2.0:1787430970.936144:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836301312 00000100:00100000:2.0:1787430970.936232:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:2.0:1787430970.936244:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:15633:x1874256836301312:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430970.936263:0:19073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430970.936281:0:19073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138dd0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.936314:0:19073:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 8 pid: 18623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.936324:0:19073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430970.936338:0:19073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430970.936345:0:19073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 8 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.936380:0:19073:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 8 pid: 18623 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.936396:0:19073:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 8 pid: 18623 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.936424:0:19073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19073:1874256847882624:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430970.936544:0:19073:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430970.938933:0:19073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19073:1874256847882624:192.168.202.25@tcp:104: 00010000:00010000:3.0:1787430970.938975:0:19073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 8 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.938997:0:19073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c3bf2ba00, rc 0) 00000100:00100000:3.0:1787430970.939057:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+8:15633:x1874256836301312:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 2814us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430970.939065:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1787430970.943331:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.943482:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836301440 00000100:00100000:3.0:1787430970.943493:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836301440 00010000:00010000:3.0:1787430970.943551:0:18650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 8 pid: 18623 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.943947:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1787430970.943963:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+8:2399:x1874256836301440:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430970.943995:0:18650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430970.944020:0:18650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 8 pid: 18623 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.944036:0:18650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 8 pid: 18623 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.944061:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2328afa/0x4dbb683ba6a958a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dc9 expref: 8 pid: 18623 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.944078:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430970.944083:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430970.944090:0:18650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 7 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.944100:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 7 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.944140:0:18650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 7 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.944155:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18650:1874256847882752:192.168.202.25@tcp:105: 00000100:00100000:2.0:1787430970.944238:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430970.946996:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.947091:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18650:1874256847882752:192.168.202.25@tcp:105: 00010000:00010000:2.0:1787430970.947112:0:18650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430970.947177:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2399:x1874256836301440:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 3218us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.947188:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1787430970.947263:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836301568 00000100:00100000:3.0:1787430970.947271:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836301568 00000100:00100000:3.0:1787430970.947318:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1787430970.947328:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2400:x1874256836301568:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787430970.947492:0:18624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787430970.947496:0:18624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787430970 00002000:00010000:3.0:1787430970.947499:0:18624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787430969 00002000:00010000:3.0:1787430970.947501:0:18624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787430970 -> 1787430970 00002000:00010000:3.0:1787430970.947503:0:18624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787430970.947527:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+8:2400:x1874256836301568:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 200us (541us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787430970.947533:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1787430970.950165:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.950251:0:19072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836301696 00000100:00100000:2.0:1787430970.950262:0:19072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836301696 00000100:00100000:2.0:1787430970.950332:0:19072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:2.0:1787430970.950353:0:19072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+8:2402:x1874256836301696:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787430970.950408:0:19072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.950434:0:19072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 8 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.950444:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430970.950449:0:19072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430970.950454:0:19072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.950496:0:19072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 8 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.950513:0:19072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 8 pid: 19073 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.950542:0:19072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19072:1874256847882880:192.168.202.25@tcp:104: 00000100:00100000:2.0:1787430970.950658:0:19072:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2b0211ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430970.952531:0:19072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19072:1874256847882880:192.168.202.25@tcp:104: 00010000:00010000:2.0:1787430970.952555:0:19072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430970.954080:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.954176:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836301824 00000100:00100000:0.0:1787430970.954185:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836301824 00010000:00010000:0.0:1787430970.954220:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 9 pid: 19073 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430970.954260:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:0.0:1787430970.954271:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:2399:x1874256836301824:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430970.954286:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430970.954308:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 9 pid: 19073 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.954343:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 9 pid: 19073 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.954369:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000641e0a80/0x4dbb683ba6a958b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd0 expref: 9 pid: 19073 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.954386:0:17107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430970.954390:0:17107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430970.954396:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.954408:0:17107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.954445:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430970.954754:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+8:2399:x1874256836301824:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 483us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430970.954762:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00010000:00010000:3.0:1787430970.955028:0:19072:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955040:0:19072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955062:0:19072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955071:0:19072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955088:0:19072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955095:0:19072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2be00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:3.0:1787430970.955100:0:19072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955109:0:19072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955124:0:19072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.955132:0:19072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088750907/0x4dbb683ba6a958ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430970.955182:0:19072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2402:x1874256836301696:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 4841us (5028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430970.955190:0:19072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:0.0:1787430970.958147:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1787430970.958228:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836302080 00000100:00100000:1.0:1787430970.958238:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836302080 00000100:00100000:1.0:1787430970.958318:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:1.0:1787430970.958329:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+16:15633:x1874256836302080:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787430970.958423:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.958443:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 16 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.958452:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.958491:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 16 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.958507:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 16 pid: 17121 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430970.958519:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847883008:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430970.958861:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109eb840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430970.962255:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.962370:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836302208 00000100:00100000:2.0:1787430970.962380:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836302208 00010000:00010000:2.0:1787430970.962425:0:17106:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 17 pid: 17121 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.962471:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1787430970.962482:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+17:2400:x1874256836302208:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430970.962496:0:17106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430970.962503:0:17106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 17 pid: 17121 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.962517:0:17106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 17 pid: 17121 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.962543:0:17106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.962550:0:17106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 17 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.962562:0:17106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.962571:0:17106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.962598:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.962656:0:17106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430970.962705:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+17:2400:x1874256836302208:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 225us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.962711:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00010000:00010000:1.0:1787430970.963470:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8a000/0x4dbb683ba6a9580b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d91 expref: 16 pid: 17121 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430970.963490:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847883008:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430970.963515:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.963537:0:17120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.963556:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.963809:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.963823:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 16 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.963831:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.963858:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 16 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430970.963872:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 16 pid: 17120 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430970.963886:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847883136:192.168.202.25@tcp:104: 00000100:00100000:1.0:1787430970.964136:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c3a761f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430970.969428:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847883136:192.168.202.25@tcp:104: 00010000:00010000:1.0:1787430970.969462:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430970.971044:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1787430970.971293:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836302336 00000100:00100000:2.0:1787430970.971302:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836302336 00010000:00010000:2.0:1787430970.971355:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 17 pid: 17120 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.971465:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1787430970.971478:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+17:2399:x1874256836302336:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430970.971493:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430970.971501:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 17 pid: 17120 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.971517:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 17 pid: 17120 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.971541:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360ef800/0x4dbb683ba6a95890 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dbb expref: 17 pid: 17120 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.971561:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:2.0:1787430970.971567:0:17105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.971648:0:17105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.971657:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.971680:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430970.971731:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+16:2399:x1874256836302336:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 255us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430970.971739:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00010000:00010000:2.0:1787430970.973227:0:17120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.973242:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430970.973381:0:17120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787430970.973498:0:17120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787430970.973535:0:17120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787430970.973650:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17120:1874256847883264:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787430970.973716:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430970.973741:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c109eb840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430970.974038:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847883264 00000100:00100000:0.0:1787430970.974047:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847883264 00000100:00100000:0.0:1787430970.974107:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787430970.974120:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17120:x1874256847883264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787430970.974233:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17120:x1874256847883264:12345-0@lo:1000:mdt00_000.0 Request processed in 115us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430970.974253:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787430970.974580:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17120:1874256847883264:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787430970.974795:0:17120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787430970.974846:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17120:1874256847883392:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787430970.974878:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430970.974925:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430970.975047:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847883392 00000100:00100000:3.0:1787430970.975053:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847883392 00000100:00100000:3.0:1787430970.975086:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787430970.975094:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17120:x1874256847883392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787430970.975222:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17120:x1874256847883392:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (342us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787430970.975240:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787430970.975307:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17120:1874256847883392:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787430970.975357:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975366:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975373:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975379:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360efc00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.975384:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975391:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975406:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:2.0:1787430970.975409:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430970.975414:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975419:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360efc00/0x4dbb683ba6a958c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975454:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975461:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975466:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975483:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eee00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.975486:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975491:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975500:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.975502:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430970.975510:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 19 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975522:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 19 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975530:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 19 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.975583:0:17120:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2b800/0x4dbb683ba6a95827 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138d9f expref: 19 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.975595:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847883520:192.168.202.25@tcp:105: 00000100:00100000:2.0:1787430970.976025:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8e2c04dfe480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430970.978665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.978739:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836302464 00000100:00100000:0.0:1787430970.978748:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836302464 00000100:00100000:0.0:1787430970.978799:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1787430970.978809:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c35cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:15632:x1874256836302464:12345-192.168.202.25@tcp:49:dd.0 00000100:00100000:0.0:1787430970.978948:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c35cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:15632:x1874256836302464:12345-192.168.202.25@tcp:49:dd.0 Request processed in 141us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430970.978956:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:1.0:1787430970.981183:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430970.981244:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836302592 00000100:00100000:3.0:1787430970.981252:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836302592 00000100:00100000:3.0:1787430970.981299:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1787430970.981308:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:15632:x1874256836302592:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1787430970.981341:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430970.981367:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a958cf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc1344e3b9138dd7 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.981411:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.981425:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.981433:0:17122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.981451:0:17122:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.981459:0:17122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430970.981797:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17120:1874256847883520:192.168.202.25@tcp:105: 00010000:00010000:2.0:1787430970.981823:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981853:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eee00/0x4dbb683ba6a95820 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981878:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981886:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981949:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981960:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981965:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981969:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981973:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a600 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.981975:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981980:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.981987:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.981989:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430970.981991:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982000:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c3bf2a600/0x4dbb683ba6a958dd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982007:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982011:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982014:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982017:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c360eec00 already unused, calling callback (ffffffffc1a5e4f0) 00010000:00010000:2.0:1787430970.982019:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982022:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982027:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:2.0:1787430970.982028:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430970.982030:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982034:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982037:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982053:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.982065:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c360eec00/0x4dbb683ba6a958c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.982084:0:17122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.982090:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.982206:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8bc00/0x4dbb683ba6a958cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd7 expref: 22 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.982219:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c35e8ae00/0x4dbb683ba6a958d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xdc1344e3b9138dd7 expref: 21 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430970.982227:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e2b03b34600) 00010000:00010000:3.0:1787430970.982229:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430970.982231:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2c35e8ae00, rc 0) 00000100:00100000:2.0:1787430970.982235:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+21:15633:x1874256836302080:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 23908us (24097us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787430970.982244:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000020:00080000:2.0:1787430970.982249:0:17120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787430970.982253:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+21:15632:x1874256836302592:12345-192.168.202.25@tcp:101:dd.0 Request processed in 947us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430970.982258:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000040:00080000:1.0:1787430970.982394:0:17154:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787430970.982399:0:17154:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430970.982414:0:17154:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787430970.982425:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787430970.987957:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1787430970.988028:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836302848 00000100:00100000:0.0:1787430970.988039:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836302848 00000100:00100000:0.0:1787430970.988096:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1787430970.988107:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+20:15633:x1874256836302848:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787430970.988383:0:17123:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787430970.988420:0:17123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787430970.988454:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.988473:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.988484:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.988492:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.988499:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.988528:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430970.988553:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430970.988579:0:17108:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430970.988587:0:17108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.988594:0:17108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c01491e00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430970.988599:0:17108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.988639:0:17108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430970.988654:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2c11493400) 00010000:00010000:2.0:1787430970.988658:0:17108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787430970.988665:0:17108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430970.988672:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+22:15633:x1874256836302848:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 566us (725us total) trans 8589934622 rc 0/0 00010000:00010000:2.0:1787430970.988680:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2c01491e00/0x4dbb683ba6a958e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430970.988680:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000020:00080000:0.0:1787430970.988685:0:17123:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787430970.988692:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430970.988694:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430970.988695:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430971.107573:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430971.107687:0:18628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836302976 00000100:00100000:3.0:1787430971.107696:0:18628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836302976 00000100:00100000:3.0:1787430971.107756:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1787430971.107765:0:18628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2400:x1874256836302976:12345-192.168.202.25@tcp:4:dd.0 00002000:00010000:3.0:1787430971.107816:0:18628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8a083a, atime: 0x6a8a0839, ctime: 0x6a8a083a, blocks: 0x0 00010000:00010000:3.0:1787430971.107824:0:18628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430971.107836:0:18628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1787430971.107839:0:18628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430971.107844:0:18628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430971.107854:0:18628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430971.114001:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1787430971.114056:0:18630:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787430971.114067:0:18630:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787430971.115249:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256836303104 00000100:00100000:1.0:1787430971.115263:0:18630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256836303104 00000100:00100000:2.0:1787430971.115754:0:20256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:2.0:1787430971.115772:0:20256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+9:2399:x1874256836303104:12345-192.168.202.25@tcp:4:dd.0 00010000:00010000:2.0:1787430971.115809:0:20256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.115827:0:20256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430971.115832:0:20256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430971.115839:0:20256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.115853:0:20256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430971.135769:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847883776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430971.135829:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.135990:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430971.135999:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847883904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430971.136026:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430971.136143:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847883648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787430971.136181:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847884032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430971.136347:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430971.136496:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.136662:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847884288:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.136764:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.136785:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847884800:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.136808:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.136826:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847885312:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.136874:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.136893:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787430971.136898:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847884416:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.136927:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.136941:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847884928:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.136959:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.136984:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884800 00000100:00100000:3.0:1787430971.136991:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884800 00000100:00100000:3.0:1787430971.137023:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847885312 00000100:00100000:3.0:1787430971.137025:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847885312 00000100:00100000:3.0:1787430971.137039:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884416 00000100:00100000:3.0:1787430971.137041:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884416 00000100:00100000:3.0:1787430971.137046:0:19453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884928 00000100:00100000:3.0:1787430971.137053:0:19453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884928 00000100:00100000:3.0:1787430971.137067:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430971.137072:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847884800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.137109:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1874256847884800:12345-0@lo:400:kworker.0 Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430971.137114:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430971.137124:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787430971.137128:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847885312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.137142:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1874256847885312:12345-0@lo:400:kworker.0 Request processed in 15us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430971.137146:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787430971.137151:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787430971.137155:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847884416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.137166:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b0357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1874256847884416:12345-0@lo:400:kworker.0 Request processed in 11us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430971.137170:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787430971.137175:0:19453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430971.137178:0:19453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847884928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.137189:0:19453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1874256847884928:12345-0@lo:400:kworker.0 Request processed in 11us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430971.137193:0:19453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430971.137219:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1874256847884416:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.137225:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1874256847884928:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.137230:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1874256847884800:0@lo:400:kworker.0 00010000:00080000:3.0:1787430971.137246:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b0357b800 x1874256847885312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430971.137253:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1874256847885312:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.137381:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847883776 00000100:00100000:2.0:1787430971.137386:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847883776 00000100:00100000:2.0:1787430971.137411:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847883904 00000100:00100000:2.0:1787430971.137414:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847883904 00000100:00100000:2.0:1787430971.137427:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884032 00000100:00100000:2.0:1787430971.137430:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884032 00000100:00100000:2.0:1787430971.137442:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787430971.137448:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847883776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787430971.137463:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 34029248 pending 7704576 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787430971.137501:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1874256847883776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.137507:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787430971.137521:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430971.137525:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847883904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430971.137539:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787430971.137615:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847883904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.137619:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430971.137628:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430971.137631:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847884032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430971.137638:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 34029248 pending 7704576 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787430971.137652:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1874256847884032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 21us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.137655:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430971.137681:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884288 00000100:00100000:2.0:1787430971.137683:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884288 00000100:00100000:2.0:1787430971.137697:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430971.137701:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847884288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.137720:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b03578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1874256847884288:12345-0@lo:400:kworker.0 Request processed in 19us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.137723:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430971.137738:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847884544:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.137753:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430971.137764:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847885056:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.137776:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430971.137800:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847884032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430971.137812:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787430971.137818:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847884160:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.137844:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430971.137868:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847884672:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.137901:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430971.137930:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b03fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847885184:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.137954:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430971.137979:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884160 00000100:00100000:2.0:1787430971.137983:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884160 00000100:00100000:2.0:1787430971.138008:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787430971.138015:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2c05467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3629:x1874256847884160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.138046:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2c05467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1+24:3629:x1874256847884160:12345-0@lo:400:kworker.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.138052:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787430971.138083:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fee52dc1-c4f0-4b23-ab4e-898c85fea4e1:3629:1874256847884160:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.138101:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847885056 00000100:00100000:2.0:1787430971.138104:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847885056 00000100:00100000:2.0:1787430971.138125:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847885184 00000100:00100000:2.0:1787430971.138127:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847885184 00000100:00100000:2.0:1787430971.138137:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430971.138141:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847885056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.138170:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874256847885056:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.138176:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787430971.138198:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2b03fcf100 x1874256847885056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430971.138208:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1874256847885056:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.138223:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787430971.138230:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847885184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.138270:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874256847885184:12345-0@lo:400:kworker.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.138277:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787430971.138300:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1874256847885184:0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.138330:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884544 00000100:00100000:2.0:1787430971.138334:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884544 00000100:00100000:2.0:1787430971.138356:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787430971.138362:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847884544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430971.138395:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847884544:12345-0@lo:400:kworker.0 Request processed in 33us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.138401:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787430971.138426:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847884544:0@lo:400:kworker.0 00000100:00080000:2.0:1787430971.138693:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430971.138697:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430971.138700:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430971.138703:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787430971.138806:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847884288:0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.138823:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1874256847883904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430971.138835:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1874256847883776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787430971.138862:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847884672 00000100:00100000:3.0:1787430971.138865:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847884672 00000100:00100000:3.0:1787430971.138905:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430971.138926:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847884672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430971.138964:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1874256847884672:12345-0@lo:400:kworker.0 Request processed in 39us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430971.138971:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430971.138995:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b03fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1874256847884672:0@lo:400:kworker.0 00000100:00100000:0.0:1787430971.139260:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847883648 00000100:00100000:0.0:1787430971.139266:0:18627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847883648 00000100:00080000:2.0:1787430971.139313:0:17116:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430971.139361:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787430971.139427:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847883648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787430971.139439:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787430971.139480:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874256847883648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.139488:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430971.139572:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1874256847883648:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1787430971.175861:0:19439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787430971.175881:0:19439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1787430971.176236:0:18628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787430971.176242:0:18628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787430970 -> 1787430971 00002000:00010000:2.0:1787430971.176245:0:18628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787430970 -> 1787430971 00002000:00010000:2.0:1787430971.176248:0:18628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1787430971.176289:0:18628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.176304:0:18628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.176315:0:18628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.176513:0:18628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c35e8bc00 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430971.176519:0:18628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.176528:0:18628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.176549:0:18628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.176559:0:18628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005854f1f9/0x4dbb683ba6a958eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430971.176779:0:18628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+7:2400:x1874256836302976:12345-192.168.202.25@tcp:4:dd.0 Request processed in 69008us (69206us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787430971.176790:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000001:00080000:0.0:1787430971.212127:0:19439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787430971.212313:0:20256:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1787430971.212320:0:20256:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1787430971.212349:0:20256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.212375:0:20256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.212385:0:20256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.212393:0:20256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2c3bf2a600 already unused, calling callback (ffffffffc0e31230) 00010000:00010000:2.0:1787430971.212398:0:20256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.212408:0:20256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.212431:0:20256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430971.212438:0:20256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005f508cb/0x4dbb683ba6a958f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430971.212643:0:20256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c368a6e6-7ccb-40c4-87da-4ec7f1c901a6+5:2399:x1874256836303104:12345-192.168.202.25@tcp:4:dd.0 Request processed in 96829us (98606us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787430971.212655:0:20256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00010000:00010000:1.0:1787430971.519917:0:17109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430971.648092:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847885440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787430971.648179:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430971.648977:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847885440 00000100:00100000:3.0:1787430971.648989:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847885440 00000100:00100000:3.0:1787430971.649055:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787430971.649067:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b034f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847885440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787430971.649103:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787430971.649286:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8e2b04d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847885568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787430971.649317:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430971.649351:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256847885568 00000100:00100000:2.0:1787430971.649368:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256847885568 00000100:00100000:2.0:1787430971.649390:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430971.649397:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2b04d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847885568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787430971.649414:0:17126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787430971.649449:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b04d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874256847885568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430971.649457:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430971.649499:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b04d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1874256847885568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787430971.649801:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2b034f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1874256847885440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 736us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430971.649808:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787430971.650814:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8e2b0357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1874256847885440:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787430972.223947:0:20293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787430972.543760:0:17108:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 39792 lines, 39792 kept, 0 dropped, 0 bad.